-- Logs begin at Thu 2022-08-18 10:32:34 UTC, end at Thu 2022-08-18 11:55:24 UTC. -- Aug 18 11:08:51.544430 dv-cinder-853450-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 11:08:51.553409 dv-cinder-853450-2-smb devstack@keystone.service[81572]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 11:08:51 2022] *** Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: nodename: dv-cinder-853450-2-smb Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: machine: x86_64 Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: clock source: unix Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: pcre jit disabled Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: detected number of CPU cores: 4 Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: current working directory: / Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: detected binary path: /usr/bin/uwsgi-core Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: your processes number limit is 47680 Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: your memory page size is 4096 bytes Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: detected max file descriptor number: 2048 Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: lock engine: pthread robust mutexes Aug 18 11:08:51.555657 dv-cinder-853450-2-smb devstack@keystone.service[81572]: thunder lock: enabled Aug 18 11:08:51.558311 dv-cinder-853450-2-smb devstack@keystone.service[81572]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 11:08:51.558311 dv-cinder-853450-2-smb devstack@keystone.service[81572]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 11:08:51.594629 dv-cinder-853450-2-smb devstack@keystone.service[81572]: Python main interpreter initialized at 0x55c812fe09c0 Aug 18 11:08:51.594629 dv-cinder-853450-2-smb devstack@keystone.service[81572]: python threads support enabled Aug 18 11:08:51.594629 dv-cinder-853450-2-smb devstack@keystone.service[81572]: your server socket listen backlog is limited to 100 connections Aug 18 11:08:51.594629 dv-cinder-853450-2-smb devstack@keystone.service[81572]: your mercy for graceful operations on workers is 90 seconds Aug 18 11:08:51.594979 dv-cinder-853450-2-smb devstack@keystone.service[81572]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 11:08:51.595064 dv-cinder-853450-2-smb devstack@keystone.service[81572]: *** Operational MODE: preforking *** Aug 18 11:08:51.595337 dv-cinder-853450-2-smb devstack@keystone.service[81572]: *** uWSGI is running in multiple interpreter mode *** Aug 18 11:08:51.595337 dv-cinder-853450-2-smb devstack@keystone.service[81572]: spawned uWSGI master process (pid: 81572) Aug 18 11:08:51.595540 dv-cinder-853450-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 18 11:08:51.598068 dv-cinder-853450-2-smb devstack@keystone.service[81572]: spawned uWSGI worker 1 (pid: 81583, cores: 1) Aug 18 11:08:51.598068 dv-cinder-853450-2-smb devstack@keystone.service[81572]: spawned uWSGI worker 2 (pid: 81584, cores: 1) Aug 18 11:08:51.598365 dv-cinder-853450-2-smb devstack@keystone.service[81572]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 11:08:55.994340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:08:55.994340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Aug 18 11:08:55.995119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:08:55.995119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: from cryptography.utils import int_from_bytes Aug 18 11:08:55.995560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:08:55.995560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Aug 18 11:08:55.995695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:08:55.995695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: from cryptography.utils import int_from_bytes Aug 18 11:08:56.045509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:08:56.045700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:08:56.045892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] command line args: [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:08:56.046161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:08:56.046340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ================================================================================ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:08:56.046594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] admin_token = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.046886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config_dir = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.047069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.047253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config_source = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.047432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] debug = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.047632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.048102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.048190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:08:56.048298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.048366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:08:56.048430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.048493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] command line args: [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:08:56.048667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.048810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:08:56.048894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.048954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ================================================================================ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:08:56.049066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_config_append = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_dir = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_dir = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_source = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.049992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] debug = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.050116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.050202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.050302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.051930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_config_append = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_dir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.052977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.053143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.053242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.053376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.053457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.053620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.053710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.053879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] publish_errors = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.054972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] standard_threads = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.055987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.056064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.056259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.056385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.056639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.056639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_journal = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.056792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_json = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.056912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.86/identity {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_stderr = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] publish_errors = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_syslog = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.057720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.057804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.057969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.058053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.058206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.058293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.058444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] standard_threads = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.058528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.058678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.058756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.058925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.059005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.059103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.059181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.059281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_journal = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.059459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_json = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.059621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.059697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_stderr = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.059794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.059885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_syslog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.060025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:08:56.060107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.060308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.060408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.060530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.060639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.060789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.060880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.061860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.062840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.063807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.064951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.065890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.066946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.067872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.068026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.068284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.068369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.068622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.068707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.068870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.071993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072198 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.072947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.073938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.074953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075221 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075489 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.075955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.076959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.077987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078059 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.078842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.079958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.080914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.081931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.external = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.082942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.password = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.083933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.token = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.084986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.external = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.085949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.password = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.token = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.086916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.087124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.087244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.087451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.087548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.087618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.087760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.087861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.088933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.089899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.090939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.091981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.092060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.092233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.094995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.095883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.096961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.097043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.097117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.097189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.097189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.097880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.097880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.098933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.099885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.100865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.101959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.102914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.103878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.104853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.105057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.105201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.105283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.105449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.105694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.105772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.105929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.106974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.107926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.108901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.109860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.110958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.111919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.112935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.113049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.113883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.113970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.114984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.115933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.116924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.117869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.118833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119271 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.119948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.120937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121017 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121518 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121683 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.121930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.122904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.123884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.124053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.124265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.124352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.124490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.124569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.124749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.127653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.127653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.127831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.127904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.127976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.128954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.129971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.130993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.131958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.132965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.133928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134471 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.134936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.135089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.135169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.135262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:08:56.135343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.135558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.135806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.136047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.136320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.136562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.136809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.137045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.137289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.137662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:08:56.137836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:08:56.165635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.165864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.166202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.166840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.167078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.167311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.174859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.176607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.203735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.203955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.205349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.205587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.265159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.265336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.316011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.316241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.316397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.316547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.488089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.488418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.488500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.488570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.488693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.488775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.488921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.489003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.489145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.489235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.489365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.489584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.512181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.512447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.512680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.512908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.513993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.514212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.514430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.525797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.526256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.544705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.544880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.544971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545219 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.545871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.546002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.546083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.546218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 11:08:56.562635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.562851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 11:08:56.562938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.563081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 11:08:56.563198 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.563403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 11:08:56.563494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.563609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 11:08:56.563691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.563884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.563971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.564148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.564478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.564699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.564781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.565050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.574972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.575226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.575322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.575513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.575604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.575787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.575893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.576101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.583741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.583846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.586662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.586750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.586954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.587038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.587242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.587325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.587530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.587620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.587819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.587983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.588093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.588177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.594729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.594816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.594881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.594954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.595027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.595101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.595187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.595264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.595337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.595417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.611983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.612372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.613643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.613927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.614129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.614415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.618593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.618887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.619120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.619215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.619351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.619634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.625609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.625904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.625986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.626216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.630755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.631047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.631131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.631340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.631423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.631629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.631712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.631912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.631997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.632189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.632300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.632489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.632585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.632764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.632846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.633035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.650362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.652063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.652158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.652158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.654471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.655034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.657838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.658138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.658281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.658579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.663074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.663705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.666239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.666851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.669748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.670059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.670353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.670459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.670644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.670738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.670925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.671019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.671227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.671319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.671501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.671796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.687582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.687887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.688160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.688458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.688569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.688844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.689121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.689390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.696068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.697288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.697558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.697851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.698816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.699096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.700630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.700923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.701211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.701513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.701759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.701843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.702045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.702330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.702630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.702909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.714039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.714328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.714614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.714902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.715192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.715331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.715476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.715620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.715771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.715903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.716184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.716492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.716769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.717044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.731283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.732881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.734426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.735957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.737333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.738907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.739336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.740405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.740702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.740785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.743765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.743870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.743870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.743870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.747585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.749061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.749409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.750896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.752038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.752364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.752657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.752945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.754453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.754848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.755142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.755420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.761683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.761990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.762267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.763549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.763840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.764119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.769178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.769958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.770246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.770530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.770809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.771095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.771377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.771649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.771930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.772048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 11:08:56.772204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.772358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.772514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.772730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.772878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.773015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.773168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.773317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.773444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.773580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.773813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.774086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.774367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.774637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.774916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.775187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.775465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.775731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 11:08:56.807798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c812fe09c0 pid: 81584 (default app) Aug 18 11:08:56.810555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c812fe09c0 pid: 81583 (default app) Aug 18 11:08:56.811377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa363-8019-41d0-8eda-17ce706872c4 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:08:56.818341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa363-8019-41d0-8eda-17ce706872c4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:08:56.818341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa363-8019-41d0-8eda-17ce706872c4 None None] PATH_INFO: `/v3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:08:56.818341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 791 bytes} [Thu Aug 18 11:08:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:04.248778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ae51-dbc4-4d5b-9dd0-75239dac79f7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:04.249243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ae51-dbc4-4d5b-9dd0-75239dac79f7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:04.249329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ae51-dbc4-4d5b-9dd0-75239dac79f7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:04.254476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1/2] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:04.259888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:04.260309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:04.260481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:04.330437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: INFO dbcounter [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] Registered counter for database keystone Aug 18 11:09:04.350542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG oslo_db.sqlalchemy.engines [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:09:04.356909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writer thread running {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:09:04.536356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81584) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 11:09:04.536777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81584) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 11:09:04.592019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:04.593675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:04.723428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 2/3] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 11:09:05.171773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80ae51-dbc4-4d5b-9dd0-75239dac79f7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:05.242783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: INFO dbcounter [None req-6b80ae51-dbc4-4d5b-9dd0-75239dac79f7 None None] Registered counter for database keystone Aug 18 11:09:05.265507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG oslo_db.sqlalchemy.engines [None req-6b80ae51-dbc4-4d5b-9dd0-75239dac79f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:09:05.271918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writer thread running {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:09:05.393037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80ae51-dbc4-4d5b-9dd0-75239dac79f7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:05.397699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d93c1-9c42-45a5-9e36-f2585586f071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:05.398313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d93c1-9c42-45a5-9e36-f2585586f071 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:05.398595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d93c1-9c42-45a5-9e36-f2585586f071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:05.398864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d93c1-9c42-45a5-9e36-f2585586f071 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:05.407054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d93c1-9c42-45a5-9e36-f2585586f071 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:05.459686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b83d93c1-9c42-45a5-9e36-f2585586f071 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 11:09:05.459973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d93c1-9c42-45a5-9e36-f2585586f071 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:05.469471 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 2/4] 10.222.0.86 () {58 vars in 1324 bytes} [Thu Aug 18 11:09:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:05.475559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:05.490863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521d3d-f351-4c80-9e40-e699a35d9049 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:05.495355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3cd0-b03e-4d20-b0d8-ac8041c216c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:05.496510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3cd0-b03e-4d20-b0d8-ac8041c216c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:05.496799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3cd0-b03e-4d20-b0d8-ac8041c216c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:05.497079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3cd0-b03e-4d20-b0d8-ac8041c216c0 admin admin] PATH_INFO: `/v3/projects/83901483583f4a448b5d5f90ea5d58ed` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:05.498682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3cd0-b03e-4d20-b0d8-ac8041c216c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=83901483583f4a448b5d5f90ea5d58ed)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:05.552394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING keystone.common.rbac_enforcer.enforcer [None req-264a3cd0-b03e-4d20-b0d8-ac8041c216c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 11:09:05.552740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3cd0-b03e-4d20-b0d8-ac8041c216c0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:05.557268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 3/5] 10.222.0.86 () {56 vars in 1207 bytes} [Thu Aug 18 11:09:05 2022] GET /identity/v3/projects/83901483583f4a448b5d5f90ea5d58ed => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:07.422505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948f92-3bfc-41f1-a0b7-a8e7fb871462 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:07.423012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948f92-3bfc-41f1-a0b7-a8e7fb871462 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:07.423120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948f92-3bfc-41f1-a0b7-a8e7fb871462 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:07.427431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 3/6] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:07.432852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f179a78-af7f-456b-bdd8-1e9f0a9939a6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:07.433251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f179a78-af7f-456b-bdd8-1e9f0a9939a6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:07.433421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f179a78-af7f-456b-bdd8-1e9f0a9939a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:07.453024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3f179a78-af7f-456b-bdd8-1e9f0a9939a6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:07.454533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3f179a78-af7f-456b-bdd8-1e9f0a9939a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:07.463087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 4/7] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 11:09:07.731569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948f92-3bfc-41f1-a0b7-a8e7fb871462 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:07.744226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948f92-3bfc-41f1-a0b7-a8e7fb871462 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:07.748406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8b13b-1261-4de7-9ab8-dd0f0c741c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:07.749005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b13b-1261-4de7-9ab8-dd0f0c741c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:07.749289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b13b-1261-4de7-9ab8-dd0f0c741c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:07.749568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b13b-1261-4de7-9ab8-dd0f0c741c8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:07.757852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8b13b-1261-4de7-9ab8-dd0f0c741c8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:07.759607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8b13b-1261-4de7-9ab8-dd0f0c741c8d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:07.768120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 4/8] 10.222.0.86 () {58 vars in 1324 bytes} [Thu Aug 18 11:09:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:09:07.773405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f179a78-af7f-456b-bdd8-1e9f0a9939a6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:07.782351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f179a78-af7f-456b-bdd8-1e9f0a9939a6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:07.787181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb57dc-108b-467e-a92d-219499362ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:07.787805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb57dc-108b-467e-a92d-219499362ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:07.788088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb57dc-108b-467e-a92d-219499362ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:07.788410 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb57dc-108b-467e-a92d-219499362ec1 admin admin] PATH_INFO: `/v3/users/235b477955ee423a9e9419b7e417b291` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:07.789724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb57dc-108b-467e-a92d-219499362ec1 admin admin] RBAC: Authorizing `identity:get_user(user_id=235b477955ee423a9e9419b7e417b291)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:07.791534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb57dc-108b-467e-a92d-219499362ec1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:07.793346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 5/9] 10.222.0.86 () {56 vars in 1198 bytes} [Thu Aug 18 11:09:07 2022] GET /identity/v3/users/235b477955ee423a9e9419b7e417b291 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:09.755205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8668a8-8e05-470d-980e-ae60a8c360f8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:09.755751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8668a8-8e05-470d-980e-ae60a8c360f8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:09.755751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8668a8-8e05-470d-980e-ae60a8c360f8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:09.757288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 5/10] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:09.762140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f05b-6179-4630-bed8-4904111dc520 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:09.762510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f05b-6179-4630-bed8-4904111dc520 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:09.762849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9f05b-6179-4630-bed8-4904111dc520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:09.781110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-31d9f05b-6179-4630-bed8-4904111dc520 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:09.782286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-31d9f05b-6179-4630-bed8-4904111dc520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:09.850799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7a35-57c8-4eb6-ad76-0ebd5e94f307 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:09.851181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7a35-57c8-4eb6-ad76-0ebd5e94f307 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:09.851533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e7a35-57c8-4eb6-ad76-0ebd5e94f307 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:09.852953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 6/11] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:09.858110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:09.858412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:09.858671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:09.864118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 6/12] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:09.901889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG passlib.handlers.bcrypt [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81583) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 11:09:09.902323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG passlib.handlers.bcrypt [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81583) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 11:09:09.949755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:09.951335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:10.049033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 7/13] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:10.131106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f05b-6179-4630-bed8-4904111dc520 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.154538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:10.236548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9f05b-6179-4630-bed8-4904111dc520 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.272333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.272963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.273247 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.273524 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.284536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:10.293626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:10.294702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:10.295506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 7/14] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:10.300739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.320714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.403696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf36e74-8096-4216-bc4e-9e2d03339b26 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.404462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:10.406276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:10.424016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bd44-52ac-4f0d-abc6-0c7b476061c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.442231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.443188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.443476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.443757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.444642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:10.444955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:10.446425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:10.459231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.459953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.460336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.460552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 8/15] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:10.460654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.463450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.529480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:10.530968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:10.562621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4133dd-6304-48ad-910a-02536d770673 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.595987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.596864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.597145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.597420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] PATH_INFO: `/v3/users/235b477955ee423a9e9419b7e417b291` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.599003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] RBAC: Authorizing `identity:get_user(user_id=235b477955ee423a9e9419b7e417b291)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:10.600462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:10.602020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 9/16] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/users/235b477955ee423a9e9419b7e417b291 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:10.607476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.611981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:10.630972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 8/17] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 11:09:10.636643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.643295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:10.710009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59554c-13b8-4f81-a888-f459f29e88c2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.734478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271ddd6-3226-48e4-b541-21f4f8db66c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.742920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.743550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.743832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.744107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.745242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:10.746758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:10.748581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 10/18] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:10.755317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.770760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.771405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.771696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.771972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.781933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:10.783428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:09:10.799774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:10.801465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:09:10.803086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:09:10.803086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:09:10.803086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:10.803086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 9/19] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:09:10.807232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:10.840914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:10.854281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eee77-c140-4ed3-87dd-1580d1e7ce83 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.855851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:10.889063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33d1b-8e7d-4801-b73c-54830063c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.889678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33d1b-8e7d-4801-b73c-54830063c8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.889973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33d1b-8e7d-4801-b73c-54830063c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.890251 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33d1b-8e7d-4801-b73c-54830063c8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.890978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33d1b-8e7d-4801-b73c-54830063c8c0 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.domain.id=default, user.id=235b477955ee423a9e9419b7e417b291) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:10.891292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33d1b-8e7d-4801-b73c-54830063c8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:10.892806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33d1b-8e7d-4801-b73c-54830063c8c0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:10.900915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 11/20] 10.222.0.86 () {56 vars in 1322 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/role_assignments?user.id=235b477955ee423a9e9419b7e417b291&scope.domain.id=default&role.id=e15e6a68b97848f894a24857503ceab4 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:10.905756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2076-27ff-48e8-955d-343d4d7cf5b0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:10.945546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d662-e5a9-4209-a505-7def86e3c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:10.946183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d662-e5a9-4209-a505-7def86e3c4ae None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:10.946469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d662-e5a9-4209-a505-7def86e3c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:10.946742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d662-e5a9-4209-a505-7def86e3c4ae None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:10.947414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667d662-e5a9-4209-a505-7def86e3c4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:10.947719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667d662-e5a9-4209-a505-7def86e3c4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:10.949262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667d662-e5a9-4209-a505-7def86e3c4ae None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:10.968544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 10/21] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:13.018151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3cd3-6a10-4f4b-bc35-2d949d0de691 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.018652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3cd3-6a10-4f4b-bc35-2d949d0de691 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.018723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3cd3-6a10-4f4b-bc35-2d949d0de691 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.020822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 12/22] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:13.032830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc44-6c8a-444f-a024-bbaa1846e6a7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.033334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc44-6c8a-444f-a024-bbaa1846e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.033421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc44-6c8a-444f-a024-bbaa1846e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.061454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4f20bc44-6c8a-444f-a024-bbaa1846e6a7 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:13.062652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4f20bc44-6c8a-444f-a024-bbaa1846e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:13.159598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 11/23] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:13.272657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d34c-94c1-483d-9dde-7cee02ad6526 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.272948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d34c-94c1-483d-9dde-7cee02ad6526 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.273145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d34c-94c1-483d-9dde-7cee02ad6526 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.274468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 13/24] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:13.279746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ae58-8169-44b9-b78d-2f89a62cbdad None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.280051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ae58-8169-44b9-b78d-2f89a62cbdad None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.280369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3ae58-8169-44b9-b78d-2f89a62cbdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.309198 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-09e3ae58-8169-44b9-b78d-2f89a62cbdad None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:13.310390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-09e3ae58-8169-44b9-b78d-2f89a62cbdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:13.333382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:13.391712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 12/25] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:13.417710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dacd3-1504-49e6-9e2a-2544550f7ae7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.417998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dacd3-1504-49e6-9e2a-2544550f7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.418271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dacd3-1504-49e6-9e2a-2544550f7ae7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.419837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 14/26] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:13.425101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9b77-dea2-4643-ab05-79c0018515e5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.425402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9b77-dea2-4643-ab05-79c0018515e5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.425712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9b77-dea2-4643-ab05-79c0018515e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.457740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d52a9b77-dea2-4643-ab05-79c0018515e5 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:13.458948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d52a9b77-dea2-4643-ab05-79c0018515e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:13.530432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 13/27] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:13.585603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dacd3-1504-49e6-9e2a-2544550f7ae7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:13.718290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dacd3-1504-49e6-9e2a-2544550f7ae7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:13.769835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:13.770488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.770778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.771061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.788984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:13.798295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:13.799207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:13.801289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 15/28] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:13.806396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a9b77-dea2-4643-ab05-79c0018515e5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:13.918980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:13.939835 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a9b77-dea2-4643-ab05-79c0018515e5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:13.970737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:13.991386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:13.992076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:13.992404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:13.992729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:13.993417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:13.993726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:13.995229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.008864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 14/29] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:14.014856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.018102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:14.127854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4164d92-7632-43de-973b-d0f664422148 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.164369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1155b5-6a63-4e14-882d-9f2f6f750a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.164993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1155b5-6a63-4e14-882d-9f2f6f750a64 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.165279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1155b5-6a63-4e14-882d-9f2f6f750a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.165558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1155b5-6a63-4e14-882d-9f2f6f750a64 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.166247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1155b5-6a63-4e14-882d-9f2f6f750a64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.167897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1155b5-6a63-4e14-882d-9f2f6f750a64 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.206421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8003a-787f-4952-a63f-84d5645b0b9b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.245777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcebee-077a-454b-948d-1a5393c2fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.246426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcebee-077a-454b-948d-1a5393c2fe31 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.246712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcebee-077a-454b-948d-1a5393c2fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.246989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcebee-077a-454b-948d-1a5393c2fe31 None admin] PATH_INFO: `/v3/users/235b477955ee423a9e9419b7e417b291` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.248122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcebee-077a-454b-948d-1a5393c2fe31 None admin] RBAC: Authorizing `identity:get_user(user_id=235b477955ee423a9e9419b7e417b291)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.249733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcebee-077a-454b-948d-1a5393c2fe31 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.251529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 15/30] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:14 2022] GET /identity/v3/users/235b477955ee423a9e9419b7e417b291 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:14.256622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a820-895d-4b9a-aad2-34b69f907dea None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.256622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a820-895d-4b9a-aad2-34b69f907dea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.256622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a820-895d-4b9a-aad2-34b69f907dea None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.257149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 16/31] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:14.258108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0a820-895d-4b9a-aad2-34b69f907dea None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.276065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:14.372433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0a820-895d-4b9a-aad2-34b69f907dea None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.411162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.412026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.412510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.413069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.424691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.426508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:09:14.442667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:14.443563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:09:14.444369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:09:14.444369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:09:14.444369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:14.446672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 17/32] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:14.447674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.457328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 16/33] 10.222.0.86 () {60 vars in 1131 bytes} [Thu Aug 18 11:09:13 2022] POST /identity/v3/roles => generated 219 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:14.459250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd286864-df32-41ba-8b82-b81b3c2b91e0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.459747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd286864-df32-41ba-8b82-b81b3c2b91e0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.460198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd286864-df32-41ba-8b82-b81b3c2b91e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.481587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fd286864-df32-41ba-8b82-b81b3c2b91e0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:14.483694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fd286864-df32-41ba-8b82-b81b3c2b91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:14.527454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:14.562830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 17/34] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:14.564159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd286864-df32-41ba-8b82-b81b3c2b91e0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.572682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958c04-d292-4c81-ac4b-04e34ab07700 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.592588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:14.636242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.640967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.641265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.641556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.642773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.644875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.652341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 18/35] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:14.670403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.716765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd286864-df32-41ba-8b82-b81b3c2b91e0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.789108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be883d0-b71c-453f-bb87-9f75f1bc5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.789595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be883d0-b71c-453f-bb87-9f75f1bc5375 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.789886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be883d0-b71c-453f-bb87-9f75f1bc5375 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.790176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be883d0-b71c-453f-bb87-9f75f1bc5375 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.790841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be883d0-b71c-453f-bb87-9f75f1bc5375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:14.791161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be883d0-b71c-453f-bb87-9f75f1bc5375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.792977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be883d0-b71c-453f-bb87-9f75f1bc5375 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.825178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 18/36] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:14.826521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb2c9a-7589-47c8-95f9-8b7e1a3b1e76 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.826822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb2c9a-7589-47c8-95f9-8b7e1a3b1e76 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.827106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb2c9a-7589-47c8-95f9-8b7e1a3b1e76 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.829992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 19/37] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:14.834663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692c9c0-f18c-47e3-b0ba-cfafd9991f9b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.840797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692c9c0-f18c-47e3-b0ba-cfafd9991f9b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.840797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692c9c0-f18c-47e3-b0ba-cfafd9991f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.844681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d54cc-c556-4331-8709-8c8a304f09f0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:14.856101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d692c9c0-f18c-47e3-b0ba-cfafd9991f9b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:14.857750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d692c9c0-f18c-47e3-b0ba-cfafd9991f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:14.887341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1310d-fdfb-4871-9fa9-e19669184afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:14.888049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1310d-fdfb-4871-9fa9-e19669184afb None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:14.888364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1310d-fdfb-4871-9fa9-e19669184afb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:14.888651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1310d-fdfb-4871-9fa9-e19669184afb None admin] PATH_INFO: `/v3/domains/default/users/235b477955ee423a9e9419b7e417b291/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:14.891956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1310d-fdfb-4871-9fa9-e19669184afb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=235b477955ee423a9e9419b7e417b291, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:14.893467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1310d-fdfb-4871-9fa9-e19669184afb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:14.896645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:14.946775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 20/38] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:14.947534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692c9c0-f18c-47e3-b0ba-cfafd9991f9b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:14.955785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:15.051832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692c9c0-f18c-47e3-b0ba-cfafd9991f9b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.087650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d14996-5885-4df3-8dac-fc809f1fc3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.088300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14996-5885-4df3-8dac-fc809f1fc3e3 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.088598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14996-5885-4df3-8dac-fc809f1fc3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.088869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14996-5885-4df3-8dac-fc809f1fc3e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.089519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d14996-5885-4df3-8dac-fc809f1fc3e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.090962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d14996-5885-4df3-8dac-fc809f1fc3e3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.111310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 19/39] 10.222.0.86 () {58 vars in 1361 bytes} [Thu Aug 18 11:09:14 2022] PUT /identity/v3/domains/default/users/235b477955ee423a9e9419b7e417b291/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:15.111310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405864f-5b2f-413f-bea7-41ecec1d84b0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.111310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405864f-5b2f-413f-bea7-41ecec1d84b0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.111310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405864f-5b2f-413f-bea7-41ecec1d84b0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.111310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 20/40] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:15.111310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405864f-5b2f-413f-bea7-41ecec1d84b0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.211302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 21/41] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:09:14 2022] POST /identity/v3/projects => generated 301 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:15.215046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a2bc7-2c0b-47c5-b2ce-8ed6ad901fed None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.215046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a2bc7-2c0b-47c5-b2ce-8ed6ad901fed None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.215046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a2bc7-2c0b-47c5-b2ce-8ed6ad901fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.237371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3b9a2bc7-2c0b-47c5-b2ce-8ed6ad901fed None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:15.239790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3b9a2bc7-2c0b-47c5-b2ce-8ed6ad901fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:15.314656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:15.329360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 22/42] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:15.330050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a2bc7-2c0b-47c5-b2ce-8ed6ad901fed None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.367999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405864f-5b2f-413f-bea7-41ecec1d84b0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.423733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.424460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.424748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.425031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.426317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.428000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.474759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a2bc7-2c0b-47c5-b2ce-8ed6ad901fed None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.511928 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.512607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.512895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.513179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.514333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.515849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.517677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 23/43] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:15.521121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 21/44] 10.222.0.86 () {60 vars in 1131 bytes} [Thu Aug 18 11:09:15 2022] POST /identity/v3/roles => generated 225 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:15.523433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.592973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:15.646924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4340be-255f-4407-a97a-8e318dfbfeca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.661301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:15.686046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be47b7-df93-4b92-8e3d-1fcef7faea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.686674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be47b7-df93-4b92-8e3d-1fcef7faea13 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.686964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be47b7-df93-4b92-8e3d-1fcef7faea13 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.687245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be47b7-df93-4b92-8e3d-1fcef7faea13 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.687908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be47b7-df93-4b92-8e3d-1fcef7faea13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.689482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be47b7-df93-4b92-8e3d-1fcef7faea13 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.724320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:15.772772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d17b9-6e78-4884-a023-dff814a26fbb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:15.773256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 24/45] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:09:15 2022] POST /identity/v3/projects => generated 312 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:15.819466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dbd22-7d42-46be-9921-0c7b358dea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:15.820383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dbd22-7d42-46be-9921-0c7b358dea33 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:15.820767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dbd22-7d42-46be-9921-0c7b358dea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:15.821144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dbd22-7d42-46be-9921-0c7b358dea33 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:15.821968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dbd22-7d42-46be-9921-0c7b358dea33 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:15.823813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dbd22-7d42-46be-9921-0c7b358dea33 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:15.932759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 22/46] 10.222.0.86 () {60 vars in 1131 bytes} [Thu Aug 18 11:09:15 2022] POST /identity/v3/roles => generated 223 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:17.110217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8343c-c637-4942-ba07-46841b86035a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:17.110727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8343c-c637-4942-ba07-46841b86035a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:17.110837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8343c-c637-4942-ba07-46841b86035a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:17.112189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 25/47] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:17.117938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda47c7-d6ac-446e-a0e5-c707dc2d2e03 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:17.118375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda47c7-d6ac-446e-a0e5-c707dc2d2e03 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:17.118507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda47c7-d6ac-446e-a0e5-c707dc2d2e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:17.136753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5eda47c7-d6ac-446e-a0e5-c707dc2d2e03 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:17.138269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5eda47c7-d6ac-446e-a0e5-c707dc2d2e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:17.205928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 23/48] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:17.479060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8343c-c637-4942-ba07-46841b86035a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:17.578577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8343c-c637-4942-ba07-46841b86035a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:17.588515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:17.612630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d1281-765c-4027-bbd6-99edcc1f8e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:17.613561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1281-765c-4027-bbd6-99edcc1f8e2c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:17.613909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1281-765c-4027-bbd6-99edcc1f8e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:17.614188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d1281-765c-4027-bbd6-99edcc1f8e2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:17.625096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d1281-765c-4027-bbd6-99edcc1f8e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-725d1281-765c-4027-bbd6-99edcc1f8e2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:17.630565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:17.634215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:17.634957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 26/49] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:17.637676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda47c7-d6ac-446e-a0e5-c707dc2d2e03 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:17.682300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:17.716984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54260947-6cbb-4f23-9e8f-b129fdcfa843 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:17.717274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54260947-6cbb-4f23-9e8f-b129fdcfa843 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:17.718110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54260947-6cbb-4f23-9e8f-b129fdcfa843 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:17.719444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 27/50] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:17.724684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2aef3-c56a-40d4-8807-dc526fd4972b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:17.725042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2aef3-c56a-40d4-8807-dc526fd4972b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:17.725301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2aef3-c56a-40d4-8807-dc526fd4972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:17.737237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda47c7-d6ac-446e-a0e5-c707dc2d2e03 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:17.742960 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d9e2aef3-c56a-40d4-8807-dc526fd4972b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:17.744181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d9e2aef3-c56a-40d4-8807-dc526fd4972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:17.772535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:17.773162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:17.773457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:17.773738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:17.774418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:17.774737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:17.776165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:17.785083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 24/51] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:17.790806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:17.813579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 28/52] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:17.889204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c039c-32e1-48b5-8b98-6c3652b851dd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:17.897081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:17.923517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:17.924155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:17.924478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:17.924764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] PATH_INFO: `/v3/users/235b477955ee423a9e9419b7e417b291` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:17.926430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] RBAC: Authorizing `identity:get_user(user_id=235b477955ee423a9e9419b7e417b291)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:17.927938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:17.929540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 25/53] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:17 2022] GET /identity/v3/users/235b477955ee423a9e9419b7e417b291 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:17.935165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2aef3-c56a-40d4-8807-dc526fd4972b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:18.093264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:18.135694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:18.139549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2aef3-c56a-40d4-8807-dc526fd4972b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:18.173237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:18.173881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:18.174219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:18.174844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:18.176924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:18.178379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:18.179929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 29/54] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:18.185733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:18.194835 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629ee77-9aae-4ea8-949c-e9636b978653 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:18.229606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:18.230252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:18.230541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:18.230822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:18.231945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:18.233439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:18.235003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 26/55] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:18.241311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:18.283299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:18.291567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5faa8-0aa4-4815-bcfe-2120974223b8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:18.325894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912724b-cce4-40a0-ac50-f29ea75b3a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:18.326498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912724b-cce4-40a0-ac50-f29ea75b3a89 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:18.326783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912724b-cce4-40a0-ac50-f29ea75b3a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:18.327060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912724b-cce4-40a0-ac50-f29ea75b3a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:18.327782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912724b-cce4-40a0-ac50-f29ea75b3a89 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.domain.id=default, user.id=235b477955ee423a9e9419b7e417b291) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:18.328093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912724b-cce4-40a0-ac50-f29ea75b3a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:18.329555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912724b-cce4-40a0-ac50-f29ea75b3a89 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:18.336040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 30/56] 10.222.0.86 () {56 vars in 1322 bytes} [Thu Aug 18 11:09:18 2022] GET /identity/v3/role_assignments?user.id=235b477955ee423a9e9419b7e417b291&scope.domain.id=default&role.id=e15e6a68b97848f894a24857503ceab4 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:18.341293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60972f97-c61e-460f-bbda-97aadb75ea8f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:18.379109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516cbc5-d734-4396-9156-0be81d74f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:18.379646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516cbc5-d734-4396-9156-0be81d74f795 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:18.379917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516cbc5-d734-4396-9156-0be81d74f795 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:18.380230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516cbc5-d734-4396-9156-0be81d74f795 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:18.380912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516cbc5-d734-4396-9156-0be81d74f795 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:18.382423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516cbc5-d734-4396-9156-0be81d74f795 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:18.465754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 27/57] 10.222.0.86 () {60 vars in 1140 bytes} [Thu Aug 18 11:09:18 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:20.403712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975366ed-6d9a-4a08-9199-c623798f5b95 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:20.404245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975366ed-6d9a-4a08-9199-c623798f5b95 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:20.404329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975366ed-6d9a-4a08-9199-c623798f5b95 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:20.405626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 31/58] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:20.410688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf41b8f-ad27-4054-bba3-14703a25795a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:20.411074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf41b8f-ad27-4054-bba3-14703a25795a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:20.411258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf41b8f-ad27-4054-bba3-14703a25795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:20.429562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2cf41b8f-ad27-4054-bba3-14703a25795a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:20.430762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2cf41b8f-ad27-4054-bba3-14703a25795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:20.495161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 28/59] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:20.772547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975366ed-6d9a-4a08-9199-c623798f5b95 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:20.804184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:20.873694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975366ed-6d9a-4a08-9199-c623798f5b95 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:20.906978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b392a-8042-41ff-93c1-8ccb3986e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:20.907606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b392a-8042-41ff-93c1-8ccb3986e623 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:20.907893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b392a-8042-41ff-93c1-8ccb3986e623 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:20.908169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b392a-8042-41ff-93c1-8ccb3986e623 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:20.909318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b392a-8042-41ff-93c1-8ccb3986e623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:20.911424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b392a-8042-41ff-93c1-8ccb3986e623 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:20.913012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 32/60] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:20.918804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf41b8f-ad27-4054-bba3-14703a25795a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:20.943514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:21.017431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf41b8f-ad27-4054-bba3-14703a25795a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:21.051237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4328545-768d-4348-b970-b5bd54f15eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:21.051841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328545-768d-4348-b970-b5bd54f15eff None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:21.052124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328545-768d-4348-b970-b5bd54f15eff None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:21.052428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4328545-768d-4348-b970-b5bd54f15eff None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:21.053069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4328545-768d-4348-b970-b5bd54f15eff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:21.054527 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4328545-768d-4348-b970-b5bd54f15eff None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:21.152880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 29/61] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:09:20 2022] POST /identity/v3/users => generated 275 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:24.080531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0877-54bb-451b-ab9f-4da84828aff4 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.081034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0877-54bb-451b-ab9f-4da84828aff4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.081104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0877-54bb-451b-ab9f-4da84828aff4 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.082541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 33/62] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:24.087992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c9af-70c5-4ab4-9f51-087ef350a3af None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.088828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c9af-70c5-4ab4-9f51-087ef350a3af None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.089308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c9af-70c5-4ab4-9f51-087ef350a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.108297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4615c9af-70c5-4ab4-9f51-087ef350a3af None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:24.109890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4615c9af-70c5-4ab4-9f51-087ef350a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.202093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 30/63] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:24.478115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eafad4-72b4-46ee-b3a2-47a8a9d5eb5e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.478618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eafad4-72b4-46ee-b3a2-47a8a9d5eb5e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.479040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eafad4-72b4-46ee-b3a2-47a8a9d5eb5e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.480722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 34/64] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:24.485853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842deacd-eee4-48f1-bee0-08c907ddba93 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.486311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842deacd-eee4-48f1-bee0-08c907ddba93 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.486734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842deacd-eee4-48f1-bee0-08c907ddba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.497190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998c25-8629-46b2-b0b0-9ae2aeddca09 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.497671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998c25-8629-46b2-b0b0-9ae2aeddca09 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.498120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998c25-8629-46b2-b0b0-9ae2aeddca09 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.499560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 35/65] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:24.511901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a364-9e3a-4e6e-ac41-0fcc6bb8b8fe None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.512411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a364-9e3a-4e6e-ac41-0fcc6bb8b8fe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.512832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a364-9e3a-4e6e-ac41-0fcc6bb8b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.528846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-842deacd-eee4-48f1-bee0-08c907ddba93 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:24.530268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-842deacd-eee4-48f1-bee0-08c907ddba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.537714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:24.539862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cca3a364-9e3a-4e6e-ac41-0fcc6bb8b8fe None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:24.545800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cca3a364-9e3a-4e6e-ac41-0fcc6bb8b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.622392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 31/66] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:24.629395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842deacd-eee4-48f1-bee0-08c907ddba93 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:24.635249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 36/67] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:24.636785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06408e-ce90-4e54-bf84-bda4ccdf3236 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.637207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06408e-ce90-4e54-bf84-bda4ccdf3236 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.637681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06408e-ce90-4e54-bf84-bda4ccdf3236 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.639035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 37/68] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:24.657362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf70540-755c-4768-bcc8-212b56ccdf33 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.657855 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf70540-755c-4768-bcc8-212b56ccdf33 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.658296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf70540-755c-4768-bcc8-212b56ccdf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.688089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-dbf70540-755c-4768-bcc8-212b56ccdf33 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:24.689323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dbf70540-755c-4768-bcc8-212b56ccdf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.737584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:24.799370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842deacd-eee4-48f1-bee0-08c907ddba93 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:24.815364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 38/69] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:24.820172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c50ebd-49a0-4200-a3a7-d18526343799 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.820172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c50ebd-49a0-4200-a3a7-d18526343799 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.820172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c50ebd-49a0-4200-a3a7-d18526343799 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.823039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 39/70] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:24.824142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95fb27-4577-41b6-a7a3-49e95cbefc40 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.824476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95fb27-4577-41b6-a7a3-49e95cbefc40 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.824760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95fb27-4577-41b6-a7a3-49e95cbefc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.848412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:24.849402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:24.849853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:24.850296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:24.859348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:24.862971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:24.868340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:24.869172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:24.869927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:24.870507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7d95fb27-4577-41b6-a7a3-49e95cbefc40 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:24.870575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7d95fb27-4577-41b6-a7a3-49e95cbefc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:24.872978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 32/71] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:24.881580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:24.969069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 40/72] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:24.970329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95fb27-4577-41b6-a7a3-49e95cbefc40 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.000659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4368a-f25b-4c82-bb1c-b1fae96b3070 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.037857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.038330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.038626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.038910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.039697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:25.039951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.041659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.056561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 33/73] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.057487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.076617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.094307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95fb27-4577-41b6-a7a3-49e95cbefc40 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.125035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.132988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.133851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.134140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.134422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.146573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:25.151365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:25.152401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:25.153169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 41/74] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:09:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:25.153783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.173308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773230c-6da2-47e8-8798-b88bbc1f7f6e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.207638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.208323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.208644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.208926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.220415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:25.226289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:25.227126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:25.227875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 34/75] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:25.228545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.277980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c87198-c381-47f6-be8b-686607c48870 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.312751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.313397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.313682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.313965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.329394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.330847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.332131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e7150-51a3-43f4-b83a-41c2d1e6a23e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.333061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 42/76] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.333836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.345415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.355064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.368076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.368769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.369061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.369342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.379485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:25.384834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:25.385872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 35/77] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:25.386895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.442108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fce52e-16e8-4e60-b250-7c4625463c85 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.477150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.477762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.478049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.478329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.478994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:25.479303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.480761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.488674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 43/78] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.489616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.495191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46284c0e-f565-44db-bf55-fbb34ab1c52d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.528608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.530469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.530469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.530469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.530898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:25.531207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.532627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.541140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 36/79] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.543333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.556988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.590164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.591623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2afbe-8957-4390-a285-590ff9db169f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.626578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.627213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.627498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.627775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.629681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.631142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.632775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 44/80] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.633534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.644774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda56b2-db5f-4560-94eb-3c1e2239ca27 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.678688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.679302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.679594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.679865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.733219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50809346-104f-4c6a-bd0c-cca68970d1aa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.748283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.749801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.770005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.770621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.770911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.771196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.771864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:25.772178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.773567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.775677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.782117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 45/81] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.785724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.794581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:25.849316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 37/82] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:25.850164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.884381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9de49-a97d-4164-86db-b3513ec9487c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.918348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.918979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.919266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.919547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.920708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.922147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.923719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 46/83] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.924485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.948665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fea51-59d9-45e9-9a61-545df35b222f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:25.982671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:25.983307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:25.983591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:25.983871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] PATH_INFO: `/v3/users/235b477955ee423a9e9419b7e417b291` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:25.985022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] RBAC: Authorizing `identity:get_user(user_id=235b477955ee423a9e9419b7e417b291)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:25.986476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:25.988899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 38/84] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/users/235b477955ee423a9e9419b7e417b291 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:25.989657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:25.990320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.009188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.029369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee43e9-a405-4a3a-ac9a-23c55f348e61 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.062749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.063290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.063570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.063855 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.064532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.066840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.094067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0361f7-4fcf-42c9-aef0-23987c7da58b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.127827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.129222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.129507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.129790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.130942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.132418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.134012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 39/85] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:25 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:26.134773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.180241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 47/86] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:09:25 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:26.180241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.226044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.250952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf4574-d1ec-4267-a77d-3da9e659d902 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.288683 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809135a3-e937-4cfd-99ba-0e41abef0335 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.294552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.295210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.295500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.295782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.297165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.298550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.305598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 40/87] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:26.305598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.321556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.339991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.340925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.341214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.341492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.425869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.426051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0144084-d9ec-49b8-aba6-234056823bd8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.427673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.476760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.477700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.478139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.478549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.498403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.548441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 48/88] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:26.549318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.570722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.572588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.583320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.694891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 41/89] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:26.695431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3f89f-5028-4048-afa5-5f3217610631 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.700500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.745723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.746445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.747181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.747534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.754427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.813218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8cdc8-74e3-4b0c-95f2-4abf87e83fb8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:26.840655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.843082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.858952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:26.859696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:26.860043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:26.860351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:26.861106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=38be8d9b873e4425bdf8771a0a456f65) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:26.861553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:26.863914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:26.870414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:26.872457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 42/90] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/role_assignments?user.id=38be8d9b873e4425bdf8771a0a456f65&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:26.873480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.978976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 49/91] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:26.981128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:26.991086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da79975-16e7-46ca-be10-1e699cdae01d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:27.006931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:27.031009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:27.041578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:27.041578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:27.041578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:27.041578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:27.041578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:27.041578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 43/92] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:27.042004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:27.118735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53f20-65e9-4286-98be-dfc629d52fc5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:27.151397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:27.165744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9dc22-3558-4432-b488-d5aa6b35f58d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:27.176615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:27.177274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:27.177568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:27.177849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:27.179052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:27.180548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:27.184686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 50/93] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:26 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:27.185368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:27.279743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:27.280436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:27.280729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:27.281018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] PATH_INFO: `/v3/projects/c1d2dadddea743e08c7f5b73b537758b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:27.282186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] RBAC: Authorizing `identity:get_project(project_id=c1d2dadddea743e08c7f5b73b537758b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:27.283667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:27.293539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 44/94] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:27 2022] GET /identity/v3/projects/c1d2dadddea743e08c7f5b73b537758b => generated 312 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:27.294357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:27.297975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e97bcc-9cba-4294-96d5-37402b64ad20 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:27.337354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:27.337982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:27.338272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:27.338554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:27.339286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] RBAC: Adding query filter params (role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=38be8d9b873e4425bdf8771a0a456f65) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:27.339605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:27.341092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:27.348568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 51/95] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:27 2022] GET /identity/v3/role_assignments?user.id=38be8d9b873e4425bdf8771a0a456f65&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=e06796d7090a468581574c96a6f9f18e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:27.349467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:27.426353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:27.444647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:27.516133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4b08-7710-4fb6-948b-58d2d500a7f6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:27.575444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fee3c7-92e4-4391-a435-72bc8fe490c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:27.576068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fee3c7-92e4-4391-a435-72bc8fe490c9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:27.576183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520a23-e686-4296-b411-1c71312efc26 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:27.576378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fee3c7-92e4-4391-a435-72bc8fe490c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:27.576659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fee3c7-92e4-4391-a435-72bc8fe490c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:27.577400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fee3c7-92e4-4391-a435-72bc8fe490c9 None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=c1d2dadddea743e08c7f5b73b537758b, user.id=38be8d9b873e4425bdf8771a0a456f65) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:27.577715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fee3c7-92e4-4391-a435-72bc8fe490c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:27.579153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fee3c7-92e4-4391-a435-72bc8fe490c9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:27.586031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 52/96] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:27 2022] GET /identity/v3/role_assignments?user.id=38be8d9b873e4425bdf8771a0a456f65&scope.project.id=c1d2dadddea743e08c7f5b73b537758b&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:27.682110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c367bb7-ba25-4008-a021-9ea8acc3ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:27.682680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367bb7-ba25-4008-a021-9ea8acc3ab63 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:27.683041 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367bb7-ba25-4008-a021-9ea8acc3ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:27.683248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c367bb7-ba25-4008-a021-9ea8acc3ab63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:27.684015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367bb7-ba25-4008-a021-9ea8acc3ab63 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=235b477955ee423a9e9419b7e417b291) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:27.684371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367bb7-ba25-4008-a021-9ea8acc3ab63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:27.685861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c367bb7-ba25-4008-a021-9ea8acc3ab63 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:27.696769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 45/97] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:27 2022] GET /identity/v3/role_assignments?user.id=235b477955ee423a9e9419b7e417b291&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:28.849988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f817e-1e4b-4974-a00c-3acdc1f32831 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:28.850496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f817e-1e4b-4974-a00c-3acdc1f32831 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:28.851515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f817e-1e4b-4974-a00c-3acdc1f32831 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:28.852133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 53/98] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:28.857546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea45682-7054-487f-9319-95c730b35dbb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:28.857969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea45682-7054-487f-9319-95c730b35dbb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:28.858158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea45682-7054-487f-9319-95c730b35dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:28.877572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e92e-43e6-4a8d-9845-19f1eb94a54e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:28.878416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e92e-43e6-4a8d-9845-19f1eb94a54e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:28.878823 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e92e-43e6-4a8d-9845-19f1eb94a54e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:28.880688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 54/99] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:28.882155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5ea45682-7054-487f-9319-95c730b35dbb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:28.883377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ea45682-7054-487f-9319-95c730b35dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:28.886127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176d3e-78d0-4605-b792-875d62317a1e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:28.886408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176d3e-78d0-4605-b792-875d62317a1e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:28.886747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176d3e-78d0-4605-b792-875d62317a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:28.915191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-59176d3e-78d0-4605-b792-875d62317a1e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:28.916829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-59176d3e-78d0-4605-b792-875d62317a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:29.016297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 55/100] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:29.028258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 46/101] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:29.389729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176d3e-78d0-4605-b792-875d62317a1e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:29.406236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44172-c21e-4d95-8ec1-9c05c639222d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:29.406957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44172-c21e-4d95-8ec1-9c05c639222d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:29.407437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c44172-c21e-4d95-8ec1-9c05c639222d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:29.410119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 47/102] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:29.415239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf28d3-146a-493b-8c12-76794d0c46bd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:29.415769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf28d3-146a-493b-8c12-76794d0c46bd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:29.416539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf28d3-146a-493b-8c12-76794d0c46bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:29.448159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-71bf28d3-146a-493b-8c12-76794d0c46bd None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:29.449804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-71bf28d3-146a-493b-8c12-76794d0c46bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:29.456914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:29.513647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176d3e-78d0-4605-b792-875d62317a1e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:29.527285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:29.552116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:29.552116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:29.552116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:29.552116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:29.563994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:29.570022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:29.571049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:29.572032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:29.573794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 56/103] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:29.574476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:29.594089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 48/104] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:29.595212 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf28d3-146a-493b-8c12-76794d0c46bd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:29.700122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe4a5-b173-4805-9a25-28bbeba101c4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:29.718763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:29.749513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:29.750156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:29.750442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:29.750721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:29.751990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:29.754487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:29.756309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 57/105] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:29.763028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:29.797764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf28d3-146a-493b-8c12-76794d0c46bd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:29.888972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:29.889726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:29.889909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:29.890178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:29.890881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:29.891196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:29.892636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:29.903674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 49/106] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:29.909310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:29.953375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a34e9-cc84-4112-98d2-5d4619bc25a8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:29.992390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:30.015816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:30.016817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.017384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.017857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.024144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:30.025998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:30.103427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11e0fe-d84f-4786-a50e-903a62753ac0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:30.122705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 58/107] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:09:29 2022] POST /identity/v3/projects => generated 302 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:30.124025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:30.178305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:30.180557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.182350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.182890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] PATH_INFO: `/v3/users/b92478754ac84a59818285655cb69274` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.186566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:30.230387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] RBAC: Authorizing `identity:get_user(user_id=b92478754ac84a59818285655cb69274)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:30.232387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:30.238497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 50/108] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:29 2022] GET /identity/v3/users/b92478754ac84a59818285655cb69274 => generated 289 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:30.243377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:30.349129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee68d11-67db-4582-ad07-09b586d1c64f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:30.411051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84d5e2-6d82-4c21-83e3-a2dfe4d0a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:30.412114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84d5e2-6d82-4c21-83e3-a2dfe4d0a3cb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.412619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84d5e2-6d82-4c21-83e3-a2dfe4d0a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.413067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84d5e2-6d82-4c21-83e3-a2dfe4d0a3cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.418912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:30.427471 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84d5e2-6d82-4c21-83e3-a2dfe4d0a3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:30.429207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949293-260d-45df-aae7-495e9e2734ac None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5d84d5e2-6d82-4c21-83e3-a2dfe4d0a3cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:30.432940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:30.433795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:30.434555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:30.436746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 59/109] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:30.441535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2d48-01d6-4fee-9522-8038cc01fee2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.441825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2d48-01d6-4fee-9522-8038cc01fee2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.443491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2d48-01d6-4fee-9522-8038cc01fee2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.446013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 60/110] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:30.446785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f2d48-01d6-4fee-9522-8038cc01fee2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:30.478433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5138d-85e8-4201-b563-b322077aea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:30.479123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5138d-85e8-4201-b563-b322077aea27 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.479472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5138d-85e8-4201-b563-b322077aea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.479757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5138d-85e8-4201-b563-b322077aea27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.559918 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5138d-85e8-4201-b563-b322077aea27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:30.561475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5138d-85e8-4201-b563-b322077aea27 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:30.571903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:30.590406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f2d48-01d6-4fee-9522-8038cc01fee2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:30.629119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba55a43-baef-4bd8-914b-9438a5307935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:30.629754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55a43-baef-4bd8-914b-9438a5307935 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.630042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55a43-baef-4bd8-914b-9438a5307935 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.630562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba55a43-baef-4bd8-914b-9438a5307935 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.631105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba55a43-baef-4bd8-914b-9438a5307935 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:30.631478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba55a43-baef-4bd8-914b-9438a5307935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:30.632848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba55a43-baef-4bd8-914b-9438a5307935 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:30.642267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 61/111] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:30.644306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91048b3-d839-4610-8e19-4e37f3e2ffec None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.644605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91048b3-d839-4610-8e19-4e37f3e2ffec None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.644888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91048b3-d839-4610-8e19-4e37f3e2ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.663398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:30.664609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b91048b3-d839-4610-8e19-4e37f3e2ffec None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:30.665806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b91048b3-d839-4610-8e19-4e37f3e2ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:30.674120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 51/112] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:30.676241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02b7b-310b-4b28-9c1d-634256075d9d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.676780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02b7b-310b-4b28-9c1d-634256075d9d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.677205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02b7b-310b-4b28-9c1d-634256075d9d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.678632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 52/113] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:30.679478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02b7b-310b-4b28-9c1d-634256075d9d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:30.753444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 62/114] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:30.754918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fdf5b-7f9f-483e-b1cb-d3eeb48fb381 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.755213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fdf5b-7f9f-483e-b1cb-d3eeb48fb381 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.755488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fdf5b-7f9f-483e-b1cb-d3eeb48fb381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.774054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ac2fdf5b-7f9f-483e-b1cb-d3eeb48fb381 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:30.775249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ac2fdf5b-7f9f-483e-b1cb-d3eeb48fb381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:30.797370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02b7b-310b-4b28-9c1d-634256075d9d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:30.836618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:30.837624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.838059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.838549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.839884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:30.841731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:30.843794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 53/115] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:30 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:30.844820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:30.852910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 63/116] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:30.854505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e84f3-da6a-4ebc-9890-b9f14eee7e35 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:30.854795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e84f3-da6a-4ebc-9890-b9f14eee7e35 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:30.855119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e84f3-da6a-4ebc-9890-b9f14eee7e35 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:30.860903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 64/117] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:30.861673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e84f3-da6a-4ebc-9890-b9f14eee7e35 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:30.915713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:30.933519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:31.012549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb66a1-116d-4cc1-816f-53643d4b64a7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.019416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e84f3-da6a-4ebc-9890-b9f14eee7e35 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.056783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b097a-b203-4704-8eed-f3bacf1f04f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.057643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b097a-b203-4704-8eed-f3bacf1f04f3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.058164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b097a-b203-4704-8eed-f3bacf1f04f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.058636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b097a-b203-4704-8eed-f3bacf1f04f3 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.059956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b097a-b203-4704-8eed-f3bacf1f04f3 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:31.061647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b097a-b203-4704-8eed-f3bacf1f04f3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:31.063734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 65/118] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:30 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:31.065217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552182-b0db-4e8c-865e-02d4182f8a07 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.066034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552182-b0db-4e8c-865e-02d4182f8a07 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.066510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552182-b0db-4e8c-865e-02d4182f8a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.069259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.069900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.070194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.070473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.071684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:31.073457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:31.076386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 54/119] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:30 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:31.082758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.088151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-06552182-b0db-4e8c-865e-02d4182f8a07 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:31.089640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-06552182-b0db-4e8c-865e-02d4182f8a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:31.172612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 66/120] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:31.179702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06552182-b0db-4e8c-865e-02d4182f8a07 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.191507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:31.214038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e840f-49be-46e2-b9f5-7c82b5657456 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.248158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:31.257163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.257984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.258596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.259020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.270580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:31.275868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:31.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:31.277522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:31.285126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 55/121] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:31.286163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.320968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06552182-b0db-4e8c-865e-02d4182f8a07 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.363740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.364371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.364662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.364952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/38be8d9b873e4425bdf8771a0a456f65/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.367011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0df468a474a2a93ed2ac7f8eabc80, user_id=38be8d9b873e4425bdf8771a0a456f65, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:31.368624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:31.403705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53a393-f25c-480e-a85d-b2d28302e146 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.428096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 67/122] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:31 2022] PUT /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/38be8d9b873e4425bdf8771a0a456f65/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:31.428096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.477085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.477831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.478152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.478495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.479255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] RBAC: Adding query filter params (role.id=8530394e88764d83bf17527b2c8c18e2, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=b92478754ac84a59818285655cb69274) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:31.479569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:31.481119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:31.494526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 56/123] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/role_assignments?user.id=b92478754ac84a59818285655cb69274&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=8530394e88764d83bf17527b2c8c18e2 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:31.495521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.527984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:31.594858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:31.608490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b0026-6726-4840-a148-60579c6756b4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.652779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.653510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.653899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.654301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.661529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048072c8-465f-41bb-a592-8a52f8700c7b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.667407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:31.673084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:31.674161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:31.676105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:31.677786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 68/124] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:31.678742 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.708011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.709134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.709610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.710023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.710831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:31.712357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:31.714002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:31.725239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 57/125] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:31.725995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.829404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c059bbf-74eb-440a-ace3-d176d0d89309 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.874794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:31.889752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.890404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.890710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.890978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.905682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35226d24-7347-4abd-bedb-72c398d34d75 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:31.917464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:31.922542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:31.923405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:31.924269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:31.927933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 69/126] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:31.928838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:31.935053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:31.966078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:31.967137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:31.967576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:31.967869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:31.968642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:31.968958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:31.970421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:31.983424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 58/127] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:31.984348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.105651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3e1a8-3da6-4b96-8940-49f79361e6d8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.161501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a907abd-ec7c-4927-a2dd-f64b7e223ed6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.189501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.190739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.191014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.191296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.196947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.198444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.200091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 70/128] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:32.200904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.211177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.211827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.212118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.212424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.213216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:32.213560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.214983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.228493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 59/129] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:32.229364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.288572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:32.345883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:32.392718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80de8-da3f-4cd1-8536-4f3fcf908acd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.402331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141ca04-9c07-47d0-9fa8-789f842690b1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.429789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.430865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.431343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.431809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.433264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.434951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.437375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 71/130] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:32 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:32.438328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.506856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.507516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.507864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.508085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.509589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.510960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.516234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 60/131] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:32 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:32.516234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.553145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355f28-8095-4e98-a071-3dc7846ad323 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.579540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:32.592329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d067592-7c66-488e-b4de-4e402e76ba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.593154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d067592-7c66-488e-b4de-4e402e76ba80 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.593946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d067592-7c66-488e-b4de-4e402e76ba80 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.593946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d067592-7c66-488e-b4de-4e402e76ba80 None admin] PATH_INFO: `/v3/users/235b477955ee423a9e9419b7e417b291` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.595240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d067592-7c66-488e-b4de-4e402e76ba80 None admin] RBAC: Authorizing `identity:get_user(user_id=235b477955ee423a9e9419b7e417b291)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.597901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d067592-7c66-488e-b4de-4e402e76ba80 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.604416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 72/132] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:32 2022] GET /identity/v3/users/235b477955ee423a9e9419b7e417b291 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:32.606065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b827e3c-119e-43c6-80f2-4abd52c8224d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.606507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b827e3c-119e-43c6-80f2-4abd52c8224d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.606923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b827e3c-119e-43c6-80f2-4abd52c8224d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.608525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 73/133] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:32.609472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b827e3c-119e-43c6-80f2-4abd52c8224d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.633636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fce7c-66fc-4143-b998-5f2ccb6b73db None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.640724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:32.669341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.670147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.670606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.670902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] PATH_INFO: `/v3/projects/c1d2dadddea743e08c7f5b73b537758b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.672331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] RBAC: Authorizing `identity:get_project(project_id=c1d2dadddea743e08c7f5b73b537758b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.673906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.681275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 61/134] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:32 2022] GET /identity/v3/projects/c1d2dadddea743e08c7f5b73b537758b => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:32.682374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.733299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b827e3c-119e-43c6-80f2-4abd52c8224d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.772775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.773740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.774362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.774821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/38be8d9b873e4425bdf8771a0a456f65/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.777460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0df468a474a2a93ed2ac7f8eabc80, user_id=38be8d9b873e4425bdf8771a0a456f65, role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.779303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.792915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821ebc6-d00a-4734-b6ac-aff32a879794 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:32.833535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84878ddb-1daa-401e-a9e4-fb04cb9da8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:32.834175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878ddb-1daa-401e-a9e4-fb04cb9da8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.834463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878ddb-1daa-401e-a9e4-fb04cb9da8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.834743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84878ddb-1daa-401e-a9e4-fb04cb9da8f8 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.835864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84878ddb-1daa-401e-a9e4-fb04cb9da8f8 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:32.837385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84878ddb-1daa-401e-a9e4-fb04cb9da8f8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:32.843942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 62/135] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:32 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:32.843942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81527fb-8030-40f9-b40e-23e888f49ab9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:32.843942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81527fb-8030-40f9-b40e-23e888f49ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:32.843942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81527fb-8030-40f9-b40e-23e888f49ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:32.859802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e81527fb-8030-40f9-b40e-23e888f49ab9 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:32.860961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e81527fb-8030-40f9-b40e-23e888f49ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:32.902284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 74/136] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:32 2022] PUT /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/38be8d9b873e4425bdf8771a0a456f65/roles/e06796d7090a468581574c96a6f9f18e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:32.903398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:32.909861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:32.977447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 63/137] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:32.978231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81527fb-8030-40f9-b40e-23e888f49ab9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:33.012132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:33.103520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94dced-92dc-4e75-a35d-834febce2b76 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:33.147756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:33.148516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.148739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.149018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] PATH_INFO: `/v3/projects/c1d2dadddea743e08c7f5b73b537758b/users/38be8d9b873e4425bdf8771a0a456f65/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.151121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1d2dadddea743e08c7f5b73b537758b, user_id=38be8d9b873e4425bdf8771a0a456f65, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:33.152608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:33.179484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81527fb-8030-40f9-b40e-23e888f49ab9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:33.217654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:33.218391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.218717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.219011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/235b477955ee423a9e9419b7e417b291/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.223158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0df468a474a2a93ed2ac7f8eabc80, user_id=235b477955ee423a9e9419b7e417b291, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:33.223158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:33.241368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 75/138] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:32 2022] PUT /identity/v3/projects/c1d2dadddea743e08c7f5b73b537758b/users/38be8d9b873e4425bdf8771a0a456f65/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:33.337923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 64/139] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:32 2022] PUT /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/235b477955ee423a9e9419b7e417b291/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:33.371653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:33.504345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dea11-3a3a-4217-ae23-34841a5dce41 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:33.521807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:33.547123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c963b7-e6a0-48b9-80f7-5eb8c26afcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:33.547811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c963b7-e6a0-48b9-80f7-5eb8c26afcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.548139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c963b7-e6a0-48b9-80f7-5eb8c26afcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.548472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c963b7-e6a0-48b9-80f7-5eb8c26afcf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.549751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c963b7-e6a0-48b9-80f7-5eb8c26afcf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:33.551234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c963b7-e6a0-48b9-80f7-5eb8c26afcf1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:33.553181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 76/140] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:33.559284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:33.597818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:33.675389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1137664-90f3-4978-ba34-412f6ee4e4f1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:33.712278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935b843-d002-469d-b246-96f748024756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:33.713031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b843-d002-469d-b246-96f748024756 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.713355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b843-d002-469d-b246-96f748024756 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.713635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935b843-d002-469d-b246-96f748024756 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.714301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b843-d002-469d-b246-96f748024756 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:33.715902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935b843-d002-469d-b246-96f748024756 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:33.732894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12d6cc-1c36-443f-b773-f9c2e2393660 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.733279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12d6cc-1c36-443f-b773-f9c2e2393660 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.733565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12d6cc-1c36-443f-b773-f9c2e2393660 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.735269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 77/141] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:33.741514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839af585-49c8-48b5-9abe-39b61b39c696 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.741802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839af585-49c8-48b5-9abe-39b61b39c696 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.742180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839af585-49c8-48b5-9abe-39b61b39c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.761899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-839af585-49c8-48b5-9abe-39b61b39c696 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:33.763239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-839af585-49c8-48b5-9abe-39b61b39c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:33.824114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 65/142] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:09:33 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:33.850620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 78/143] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:33.938285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61d16-7f5d-4cb0-a512-fbf5e54fc42a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.938594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61d16-7f5d-4cb0-a512-fbf5e54fc42a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.938854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61d16-7f5d-4cb0-a512-fbf5e54fc42a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.941054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 66/144] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:33.947782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9930a-b096-4abc-a646-8989452a2444 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:33.952202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9930a-b096-4abc-a646-8989452a2444 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:33.952202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9930a-b096-4abc-a646-8989452a2444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:33.976146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f7b9930a-b096-4abc-a646-8989452a2444 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:33.977544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f7b9930a-b096-4abc-a646-8989452a2444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:34.066957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 79/145] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:34.236242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61d16-7f5d-4cb0-a512-fbf5e54fc42a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:34.344053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:34.360767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61d16-7f5d-4cb0-a512-fbf5e54fc42a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:34.398298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:34.399702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:34.399996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:34.400316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:34.411926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:34.416977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:34.417802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:34.418546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 67/146] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:34.423927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9930a-b096-4abc-a646-8989452a2444 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:34.472726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:34.530935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9930a-b096-4abc-a646-8989452a2444 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:34.559479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:34.575733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:34.576741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:34.577241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:34.577712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:34.578608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:34.579108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:34.581288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:34.598150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 80/147] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:34.603457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:34.691396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063ff7-37ef-4b94-a4b2-6646578e2841 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:34.729825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:34.730548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:34.730975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:34.731291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:34.746331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:34.752080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:34.753666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:34.754411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:34.754983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 68/148] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:34.764847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:34.782615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:34.850343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5ef0-fc0f-4260-8179-d5e9ee8cee88 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:34.852239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:34.907109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fc1da-9115-4077-a6c1-63c39def2109 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:34.913018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:34.913808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:34.914092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:34.914367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] PATH_INFO: `/v3/users/b92478754ac84a59818285655cb69274` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:34.916332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] RBAC: Authorizing `identity:get_user(user_id=b92478754ac84a59818285655cb69274)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:34.918231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:34.920622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 81/149] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:34 2022] GET /identity/v3/users/b92478754ac84a59818285655cb69274 => generated 289 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:34.928947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:34.948960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:34.949579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:34.949967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:34.950249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:34.950925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:34.951228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:34.952843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:34.963288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 69/150] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:34.968882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.081259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:35.097909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acedf5-0320-40ff-9d64-1f195828e73d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.114194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8031a-5d00-4609-9963-dd9d19717465 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.160666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.161332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.161613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.161888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.165207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.167008 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.169021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 82/151] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:34 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:35.175567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.194270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.194925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.195214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.195492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.200917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.202404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.204339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 70/152] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:34 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:35.217259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.248761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:35.354236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93fb6c-8bc7-4f89-89ba-4d0fd7f9efff None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.396241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06e32a-ba02-4a09-9cd1-9e904eb60b82 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.429335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.430009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.430408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.430689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/b92478754ac84a59818285655cb69274/roles/8530394e88764d83bf17527b2c8c18e2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.434883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0df468a474a2a93ed2ac7f8eabc80, user_id=b92478754ac84a59818285655cb69274, role_id=8530394e88764d83bf17527b2c8c18e2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.436393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.439016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.439789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.440904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.441327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.450401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:35.518858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 83/153] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:35 2022] PUT /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/users/b92478754ac84a59818285655cb69274/roles/8530394e88764d83bf17527b2c8c18e2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:35.526631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.528307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.651825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 71/154] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:35.657788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.789214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:35.793431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281298b-ac17-4748-a445-94f173fb56b2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:35.833439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393ca27-6faa-47f3-8ead-ac1e910d3de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:35.834101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ca27-6faa-47f3-8ead-ac1e910d3de0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:35.834395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ca27-6faa-47f3-8ead-ac1e910d3de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:35.834718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393ca27-6faa-47f3-8ead-ac1e910d3de0 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:35.840971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393ca27-6faa-47f3-8ead-ac1e910d3de0 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:35.842453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393ca27-6faa-47f3-8ead-ac1e910d3de0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:35.844244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 84/155] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:35 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:35.851945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:35.916649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:35.985805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df252f53-96ba-493c-942b-1e6355772500 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:36.027370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964b432-2367-4fbb-8815-0ac23ec49315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:36.027987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964b432-2367-4fbb-8815-0ac23ec49315 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.028289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964b432-2367-4fbb-8815-0ac23ec49315 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.028564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964b432-2367-4fbb-8815-0ac23ec49315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.029306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964b432-2367-4fbb-8815-0ac23ec49315 None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=38be8d9b873e4425bdf8771a0a456f65) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:36.029611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964b432-2367-4fbb-8815-0ac23ec49315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:36.031132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964b432-2367-4fbb-8815-0ac23ec49315 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:36.039678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 72/156] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:35 2022] GET /identity/v3/role_assignments?user.id=38be8d9b873e4425bdf8771a0a456f65&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:36.204754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401f7-19e4-4e72-a361-1789e6af963f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.204754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401f7-19e4-4e72-a361-1789e6af963f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.204754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401f7-19e4-4e72-a361-1789e6af963f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.204754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 85/157] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:36.228124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f2b74-9661-4478-9d84-e79f832c2d1a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.228477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f2b74-9661-4478-9d84-e79f832c2d1a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.228723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f2b74-9661-4478-9d84-e79f832c2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.255641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-393f2b74-9661-4478-9d84-e79f832c2d1a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:36.256892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-393f2b74-9661-4478-9d84-e79f832c2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:36.365265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 73/158] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:36.667201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85cd2c-b2ef-4cb9-8f43-3401d4c609e6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.667698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85cd2c-b2ef-4cb9-8f43-3401d4c609e6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.667768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85cd2c-b2ef-4cb9-8f43-3401d4c609e6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.669415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 86/159] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:36.675693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11278d5-5851-4e7e-8fbe-aa12382d2f00 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.676827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11278d5-5851-4e7e-8fbe-aa12382d2f00 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.677323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11278d5-5851-4e7e-8fbe-aa12382d2f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.709600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f11278d5-5851-4e7e-8fbe-aa12382d2f00 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:36.711102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f11278d5-5851-4e7e-8fbe-aa12382d2f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:36.746952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:36.796145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 74/160] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:36.979003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90ead-362d-45b0-a160-1f972d10bc89 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.979170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90ead-362d-45b0-a160-1f972d10bc89 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.979507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee90ead-362d-45b0-a160-1f972d10bc89 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:36.980521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11278d5-5851-4e7e-8fbe-aa12382d2f00 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:36.981140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 87/161] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:36.988107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526913-67ae-4aea-ab7b-cd3714ab8118 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:36.988478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526913-67ae-4aea-ab7b-cd3714ab8118 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:36.988689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526913-67ae-4aea-ab7b-cd3714ab8118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.012258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e1526913-67ae-4aea-ab7b-cd3714ab8118 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:37.013465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e1526913-67ae-4aea-ab7b-cd3714ab8118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:37.130123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 88/162] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:37.162809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11278d5-5851-4e7e-8fbe-aa12382d2f00 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.218356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.219344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.219883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.226431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.243659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:37.248814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:37.249724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:37.250483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:37.253968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 75/163] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:09:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:09:37.259373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1526913-67ae-4aea-ab7b-cd3714ab8118 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.390512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.396877 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1526913-67ae-4aea-ab7b-cd3714ab8118 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.442219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.442841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.443125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.443405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.444077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:37.444456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.445867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.459486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 89/164] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:37.464651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.491611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.502495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.629543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f7dfc-2132-40af-8759-dc32c0d2531f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.671556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b0a3f-b7c0-46bd-9b22-361a8ad2cb1f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.709255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.710811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.711292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.711772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.717210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:37.719176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:37.722257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 76/165] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:37.728759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.745024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.745688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.745977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.746259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:37.768726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:37.774307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:37.775168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:37.775993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 90/166] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:09:37.780194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:37.813701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.902565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:37.920172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31fd6-e63f-4f92-9dea-3ce5d4377f14 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.985010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f74601-574a-4240-9afb-9a91ddca05d5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:37.994598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:37.995232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:37.995516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:37.995793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.052692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.053486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.053774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.054051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.078858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:38.084512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:38.085412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:38.086205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 91/167] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:38.090958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.137052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.139061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.240504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:38.279365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea5bb9-535a-459a-8a88-8534681d73cb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.345891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:38.347660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.348175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.348482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.348754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.351152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:38.351152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.351152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.364232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 77/168] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 11:09:38.364492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 92/169] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:38.365408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.369638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.528501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83f4d4-4dbb-46b9-bd31-a46adc563faa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.567740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0678ff1-835a-4533-b117-3826414b6b84 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.590930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.591883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.593184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.594340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.595632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:38.598088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.599640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.613672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 93/170] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:38.615099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.618410 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:38.630460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592543c6-d2e5-4612-b8e0-bd1faad4e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.632822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592543c6-d2e5-4612-b8e0-bd1faad4e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.632822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592543c6-d2e5-4612-b8e0-bd1faad4e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.632822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592543c6-d2e5-4612-b8e0-bd1faad4e2e8 None admin] PATH_INFO: `/v3/users/235b477955ee423a9e9419b7e417b291` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.633897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592543c6-d2e5-4612-b8e0-bd1faad4e2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=235b477955ee423a9e9419b7e417b291)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.635980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592543c6-d2e5-4612-b8e0-bd1faad4e2e8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.637803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 78/171] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/users/235b477955ee423a9e9419b7e417b291 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:38.639393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848823b-e5fc-4169-9bef-98acc4b52084 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.639935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848823b-e5fc-4169-9bef-98acc4b52084 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.640246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848823b-e5fc-4169-9bef-98acc4b52084 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.641614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 79/172] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:38.643357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13359e0e-4ec0-4a63-8a8f-bb2197163960 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.643643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13359e0e-4ec0-4a63-8a8f-bb2197163960 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.643917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13359e0e-4ec0-4a63-8a8f-bb2197163960 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.649272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 80/173] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:38.651238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13359e0e-4ec0-4a63-8a8f-bb2197163960 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.730097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:38.751524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8269b-2d38-4928-82b5-0dee763f4c0e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.784431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13359e0e-4ec0-4a63-8a8f-bb2197163960 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.790372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.791547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.792036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.792557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.793713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.795149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.797088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 94/174] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:38.798329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:38.825212 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bade8-be76-49bf-a679-bee3bc680772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.825848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bade8-be76-49bf-a679-bee3bc680772 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.826129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bade8-be76-49bf-a679-bee3bc680772 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.826404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bade8-be76-49bf-a679-bee3bc680772 None admin] PATH_INFO: `/v3/users/38be8d9b873e4425bdf8771a0a456f65` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.827677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bade8-be76-49bf-a679-bee3bc680772 None admin] RBAC: Authorizing `identity:get_user(user_id=38be8d9b873e4425bdf8771a0a456f65)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:38.829257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bade8-be76-49bf-a679-bee3bc680772 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:38.836352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 81/175] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/users/38be8d9b873e4425bdf8771a0a456f65 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:38.836352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d862-b84b-4c23-94cf-2a2da58bb31c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.836352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d862-b84b-4c23-94cf-2a2da58bb31c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.836352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d862-b84b-4c23-94cf-2a2da58bb31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.853190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a213d862-b84b-4c23-94cf-2a2da58bb31c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:38.854397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a213d862-b84b-4c23-94cf-2a2da58bb31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:38.883164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:38.914644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd3f65-0044-41b5-a904-0f783726163d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:38.932799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 82/176] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:38.934330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df766aa2-8d9a-4278-b8a1-7e07dd87d406 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.934617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df766aa2-8d9a-4278-b8a1-7e07dd87d406 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.934890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df766aa2-8d9a-4278-b8a1-7e07dd87d406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:38.952810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-df766aa2-8d9a-4278-b8a1-7e07dd87d406 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:38.953985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-df766aa2-8d9a-4278-b8a1-7e07dd87d406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:38.957303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:38.957974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:38.958265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:38.958544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.005337 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.032235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 83/177] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:39.032235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9efc53-4be6-45fa-a330-464910a85654 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.032235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9efc53-4be6-45fa-a330-464910a85654 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.032235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9efc53-4be6-45fa-a330-464910a85654 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.032235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 84/178] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:39.032235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9efc53-4be6-45fa-a330-464910a85654 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.051290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:39.053173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:39.141347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.143908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9efc53-4be6-45fa-a330-464910a85654 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:39.180538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29050b48-bf7d-405d-a059-1f96b667b036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:39.181348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29050b48-bf7d-405d-a059-1f96b667b036 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.181745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29050b48-bf7d-405d-a059-1f96b667b036 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.182116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29050b48-bf7d-405d-a059-1f96b667b036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.182950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29050b48-bf7d-405d-a059-1f96b667b036 None admin] RBAC: Adding query filter params (role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=38be8d9b873e4425bdf8771a0a456f65) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:39.183360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29050b48-bf7d-405d-a059-1f96b667b036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:39.183667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 95/179] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:39.184866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.185243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29050b48-bf7d-405d-a059-1f96b667b036 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:39.196942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 85/180] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/role_assignments?user.id=38be8d9b873e4425bdf8771a0a456f65&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=e06796d7090a468581574c96a6f9f18e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:39.196942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3ad9-e973-463e-8281-ab9d56b14c17 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.196942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3ad9-e973-463e-8281-ab9d56b14c17 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.196942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3ad9-e973-463e-8281-ab9d56b14c17 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.196942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 86/181] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:39.200278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2690-f621-47c3-83df-5201cf775764 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.200278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2690-f621-47c3-83df-5201cf775764 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.200278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a2690-f621-47c3-83df-5201cf775764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.228345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-579a2690-f621-47c3-83df-5201cf775764 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:39.229582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-579a2690-f621-47c3-83df-5201cf775764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:39.283203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.309234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 87/182] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:39.310175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a2690-f621-47c3-83df-5201cf775764 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.354737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600531f0-9fa2-47a3-95e3-21d9be17430a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:39.401443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:39.401987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.402272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.402547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.437012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a2690-f621-47c3-83df-5201cf775764 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:39.454091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.481492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad101523-657a-4438-abfa-e942b742f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:39.482136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad101523-657a-4438-abfa-e942b742f67b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.482420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad101523-657a-4438-abfa-e942b742f67b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.482697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad101523-657a-4438-abfa-e942b742f67b None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.485706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad101523-657a-4438-abfa-e942b742f67b None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:39.486158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad101523-657a-4438-abfa-e942b742f67b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:39.488048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 88/183] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:39.489401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8547b-a3f9-4133-9827-05b4ff72ab3b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.489688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8547b-a3f9-4133-9827-05b4ff72ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.489963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8547b-a3f9-4133-9827-05b4ff72ab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.498350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:39.499834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:39.508917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-49f8547b-a3f9-4133-9827-05b4ff72ab3b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:39.510101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-49f8547b-a3f9-4133-9827-05b4ff72ab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:39.555680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.580017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 89/184] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:39.581232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8547b-a3f9-4133-9827-05b4ff72ab3b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.614030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 96/185] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:39.615279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.694809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.697788 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8547b-a3f9-4133-9827-05b4ff72ab3b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:39.725994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81b32-504a-494b-b5f4-db167de75f7f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:39.733600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:39.734245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.734528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.734804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.746814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:39.751560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:39.753094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 90/186] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:39.759265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.770708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:39.771557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.771846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.772521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.773878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:39.775812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:39.777572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 97/187] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:39.778747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.797580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.862546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c7ed-1e30-40df-8d4e-75f9bac970be None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:39.883825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481454-dca8-4e3a-835a-7bc45f35299b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:39.898386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:39.899002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.899281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.899554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.900313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=235b477955ee423a9e9419b7e417b291) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:39.900627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:39.902079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:39.908035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 91/188] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/role_assignments?user.id=235b477955ee423a9e9419b7e417b291&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:39.913166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:39.920847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:39.921506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:39.921784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:39.922056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:39.932067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:39.935973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:39.941327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:39.943460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:39.944324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 98/189] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:39.948861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.036718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453eaed-9405-4b4d-bda5-950bdd79c58f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.038415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:40.075457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1dcfd-8d74-4907-be14-e63d3dd66c21 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.087542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.088194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.088588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.088870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] PATH_INFO: `/v3/projects/c1d2dadddea743e08c7f5b73b537758b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.089999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] RBAC: Authorizing `identity:get_project(project_id=c1d2dadddea743e08c7f5b73b537758b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.091754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.093118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 92/190] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/projects/c1d2dadddea743e08c7f5b73b537758b => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:40.093865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.115492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.116117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.116427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.116706 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.117389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:40.117696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.119078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.130836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 99/191] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:09:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:40.131469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.195286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:40.210193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3e2c2-9e20-4d0e-8936-d7567c65345a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.238055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a947f5-a7a2-47e1-be0b-a2628a6c769f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.244004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.244652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.244932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.245203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.245848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.247334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.271427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.272078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.272399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.272680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.282568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:40.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:40.289498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:40.290273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 100/192] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:40.291253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.353558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 93/193] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:09:40 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:40.354472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.393174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:40.398542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a80b6-2f16-4778-9b30-17e56b17720b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.421547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:40.438089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.439138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.439903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.440424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.441474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:40.441784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.443262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.452887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 101/194] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:40.453746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.484709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666542-08bb-450a-a136-babcd5d3f34c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.526989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.527572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.527856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.528135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.528897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=c1d2dadddea743e08c7f5b73b537758b, user.id=38be8d9b873e4425bdf8771a0a456f65) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:40.529265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.530656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.537660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 94/195] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/role_assignments?user.id=38be8d9b873e4425bdf8771a0a456f65&scope.project.id=c1d2dadddea743e08c7f5b73b537758b&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:40.538483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.593941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f70ee-6fc7-4f6a-a0a3-293288777521 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.638115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.638774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.639058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.639336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] PATH_INFO: `/v3/users/6b21eb819fc548aeb9f9286f617f2691` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.659417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] RBAC: Authorizing `identity:get_user(user_id=6b21eb819fc548aeb9f9286f617f2691)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.661525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:40.662184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.665115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 102/196] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/users/6b21eb819fc548aeb9f9286f617f2691 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:40.666233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.673132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2f46-0cf7-4311-8395-8744f616700b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.720375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.722174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.722733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.723212 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.724122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:40.724657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.726356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.729914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:40.747491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 95/197] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:40.747491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.809232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0b165-9734-4b6c-ac6b-23b84898028b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.856401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.857154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.857443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.857827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] PATH_INFO: `/v3/users/6b21eb819fc548aeb9f9286f617f2691` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.859071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] RBAC: Authorizing `identity:get_user(user_id=6b21eb819fc548aeb9f9286f617f2691)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.860922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.862651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 103/198] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/users/6b21eb819fc548aeb9f9286f617f2691 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:40.863430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:40.871833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1e369-3ad7-431b-b641-ee4e54050ebb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.909496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:40.910128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:40.910413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:40.910690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:40.935522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:40.979652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65af0f-ee27-4a0b-aec4-24af548f8065 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:40.987228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:40.988777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:40.990066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.017199 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.018882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.019327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.019764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] PATH_INFO: `/v3/users/b92478754ac84a59818285655cb69274` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.021179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] RBAC: Authorizing `identity:get_user(user_id=b92478754ac84a59818285655cb69274)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.022888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.024686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 104/199] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/users/b92478754ac84a59818285655cb69274 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:41.025637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.095973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 96/200] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:41.097023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.146718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b48072-9320-4501-b4bc-730cbe20c29c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.160983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.195253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.195880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.196179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.196479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.217070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50b43-3f81-4ad4-a116-af8d29a6cd9a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.259238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.271552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.272050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.272517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.273304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.289150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.290683 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.368844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.370562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.405142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 105/201] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:41.407025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.428983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.479191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 97/202] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:41.480033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.507226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.537148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0511e-37f7-4763-ab16-628a7f8c7e95 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.584973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.585905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.586196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.586475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.588371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.589883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.590283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c384a-8bf5-4883-8b16-b1c9e08c0541 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.591738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 106/203] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:41.592641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.635581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.636533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.636819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.637101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.638518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.640262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.641695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 98/204] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:41.642375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.687969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.716985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdc3ca-5b13-4c5c-93f9-21186022c4aa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.765394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.766222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.766605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.767004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.773047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.774547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.776470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 107/205] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:41.777077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.794584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307bc1-ab88-4640-b13b-25cbf708c2be None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.801321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.837762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.838814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.839390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.839877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.840868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] RBAC: Adding query filter params (role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=6b21eb819fc548aeb9f9286f617f2691) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:41.841386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.843085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.849880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 99/206] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/role_assignments?user.id=6b21eb819fc548aeb9f9286f617f2691&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=e06796d7090a468581574c96a6f9f18e => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:41.851142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:41.924507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260b57-49ac-4e92-9e32-a7a2511cae8a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.952966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:41.968716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fafe7-c8f6-4e99-83e6-a1f4ad995ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:41.969691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fafe7-c8f6-4e99-83e6-a1f4ad995ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:41.970144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fafe7-c8f6-4e99-83e6-a1f4ad995ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:41.971615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fafe7-c8f6-4e99-83e6-a1f4ad995ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:41.972667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fafe7-c8f6-4e99-83e6-a1f4ad995ad3 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=6b21eb819fc548aeb9f9286f617f2691) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:41.973202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fafe7-c8f6-4e99-83e6-a1f4ad995ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:41.973748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102567-4532-497c-a1cf-d5507940ecb5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:41.975241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fafe7-c8f6-4e99-83e6-a1f4ad995ad3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:41.982011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 108/207] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/role_assignments?user.id=6b21eb819fc548aeb9f9286f617f2691&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:42.022839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848aad5-7823-4b86-9a6f-e69eccacfdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:42.023476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848aad5-7823-4b86-9a6f-e69eccacfdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:42.023766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848aad5-7823-4b86-9a6f-e69eccacfdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:42.024044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848aad5-7823-4b86-9a6f-e69eccacfdf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:42.024826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848aad5-7823-4b86-9a6f-e69eccacfdf5 None admin] RBAC: Adding query filter params (role.id=8530394e88764d83bf17527b2c8c18e2, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80, user.id=b92478754ac84a59818285655cb69274) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:42.025145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848aad5-7823-4b86-9a6f-e69eccacfdf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:42.026625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848aad5-7823-4b86-9a6f-e69eccacfdf5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:42.034872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 100/208] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:41 2022] GET /identity/v3/role_assignments?user.id=b92478754ac84a59818285655cb69274&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=8530394e88764d83bf17527b2c8c18e2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:42.686713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928da3a-5b41-4645-857a-ea780b9de5fd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:42.687090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928da3a-5b41-4645-857a-ea780b9de5fd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:42.687286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928da3a-5b41-4645-857a-ea780b9de5fd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:42.688703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 109/209] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:42.694535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0ef55-1235-41b3-b7df-70c9b910d784 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:42.694828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0ef55-1235-41b3-b7df-70c9b910d784 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:42.695112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0ef55-1235-41b3-b7df-70c9b910d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:42.713625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-10e0ef55-1235-41b3-b7df-70c9b910d784 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:42.714816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-10e0ef55-1235-41b3-b7df-70c9b910d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:42.726374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de736c-166b-474b-8d05-04e2ba82beb2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:42.726667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de736c-166b-474b-8d05-04e2ba82beb2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:42.726944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de736c-166b-474b-8d05-04e2ba82beb2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:42.728444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 110/210] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:42.733493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64a12f-1932-4434-8121-0693d3955d78 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:42.734015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64a12f-1932-4434-8121-0693d3955d78 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:42.734484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64a12f-1932-4434-8121-0693d3955d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:42.754000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7f64a12f-1932-4434-8121-0693d3955d78 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:42.755482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7f64a12f-1932-4434-8121-0693d3955d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:42.797805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 101/211] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:42.832300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 111/212] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:43.076964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0ef55-1235-41b3-b7df-70c9b910d784 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:43.106993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64a12f-1932-4434-8121-0693d3955d78 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:43.118544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:43.168359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:43.194624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0ef55-1235-41b3-b7df-70c9b910d784 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:43.231942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:43.232833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:43.233182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:43.233562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:43.234760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:43.236991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:43.243373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 102/213] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:43.244315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:43.254929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64a12f-1932-4434-8121-0693d3955d78 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:43.302390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:43.303252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:43.303682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:43.304637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:43.319220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:43.325774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:43.326833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:43.327864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:43.330723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 112/214] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:09:43.336341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:43.363408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958e31f-bb82-47c3-877a-5f607b94ff4b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:43.412509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:43.413716 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:43.415069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:43.415503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:43.416191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:43.417289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:43.419871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:43.451573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d477992-3e3d-429a-9db5-949de52e46f2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:43.488493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:43.489115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:43.493014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:43.493014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:43.493014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:43.493014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:43.493014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:43.500950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 113/215] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:43.506355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:43.517215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 103/216] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:09:43 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:43.637957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85940972-f066-43f3-9192-2bd0edede4de None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:43.669500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:43.679457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bd4ca-4021-4de3-9e1f-2486a85467d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:43.680104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bd4ca-4021-4de3-9e1f-2486a85467d2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:43.680425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bd4ca-4021-4de3-9e1f-2486a85467d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:43.680706 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bd4ca-4021-4de3-9e1f-2486a85467d2 None admin] PATH_INFO: `/v3/users/590cf855ff054cd997e6480786913d90` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:43.695497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bd4ca-4021-4de3-9e1f-2486a85467d2 None admin] RBAC: Authorizing `identity:get_user(user_id=590cf855ff054cd997e6480786913d90)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:43.697019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bd4ca-4021-4de3-9e1f-2486a85467d2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:43.698849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 114/217] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:43 2022] GET /identity/v3/users/590cf855ff054cd997e6480786913d90 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:43.704450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:43.708831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:43.821983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f587ce-1a2d-4162-8754-00c8fbb54a66 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:43.861887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae465220-346f-4e79-b8ff-e81ff86ba631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:43.862826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465220-346f-4e79-b8ff-e81ff86ba631 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:43.863162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465220-346f-4e79-b8ff-e81ff86ba631 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:43.863394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465220-346f-4e79-b8ff-e81ff86ba631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:43.938966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae465220-346f-4e79-b8ff-e81ff86ba631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:43.941494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae465220-346f-4e79-b8ff-e81ff86ba631 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:43.943485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:44.021099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cbc07-6e96-4272-becf-9e1dd6b05372 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.021389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cbc07-6e96-4272-becf-9e1dd6b05372 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.021797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cbc07-6e96-4272-becf-9e1dd6b05372 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.025347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 115/218] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:44.029662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a1c64-36b8-438c-a746-2ec49d278e53 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.029931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a1c64-36b8-438c-a746-2ec49d278e53 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.030215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a1c64-36b8-438c-a746-2ec49d278e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.059769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 104/219] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:44.062140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e3f72-55c1-49bc-989c-480fc821c1a1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.062629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e3f72-55c1-49bc-989c-480fc821c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.063196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e3f72-55c1-49bc-989c-480fc821c1a1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.065380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 105/220] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:44.066612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e3f72-55c1-49bc-989c-480fc821c1a1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:44.071707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b89a1c64-36b8-438c-a746-2ec49d278e53 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:44.072963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b89a1c64-36b8-438c-a746-2ec49d278e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:44.150977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 116/221] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:44.153121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75986c48-b5af-4ef3-ae9e-06f98cde28be None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.153601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75986c48-b5af-4ef3-ae9e-06f98cde28be None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.154066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75986c48-b5af-4ef3-ae9e-06f98cde28be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.174927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-75986c48-b5af-4ef3-ae9e-06f98cde28be None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:44.176831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-75986c48-b5af-4ef3-ae9e-06f98cde28be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:44.183033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e3f72-55c1-49bc-989c-480fc821c1a1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:44.184625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:44.218942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:44.219637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.219924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.220200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.222384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:44.223832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:44.225836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 106/222] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:44 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:44.233727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:44.280200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 117/223] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:44.350343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfeac-9597-41f0-92c7-a73b8770f0f9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:44.385203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:44.385811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.386094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.386366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.387104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=590cf855ff054cd997e6480786913d90) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:44.387413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:44.388888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:44.395546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 107/224] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:44 2022] GET /identity/v3/role_assignments?user.id=590cf855ff054cd997e6480786913d90&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:44.513046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75986c48-b5af-4ef3-ae9e-06f98cde28be None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:44.568467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:44.569977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:44.633787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:44.636566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75986c48-b5af-4ef3-ae9e-06f98cde28be None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:44.676511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:44.677620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.677967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.678331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.690587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:44.697799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:44.698888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:44.699860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 118/225] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:09:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:44.706171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:44.748190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e33d88-8668-4735-b710-2880ced4c6c9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:44.811591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:44.812244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.812529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.812802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:44.835856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:44.841392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:44.842268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:44.843472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 108/226] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:44.851361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:44.926433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95388aa-4daf-4e9b-a94f-303fe021bb22 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:44.935452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:44.997322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:44.998317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:44.998805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:44.999301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.000298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:45.000819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.003239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.006393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509411c6-8516-4433-a7ab-79e639161b74 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.022444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:45.024340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 119/227] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:09:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:45.030373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.051072 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.051709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.052000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.052403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.053085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:45.053395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.055389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.067112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 109/228] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:45.074956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.203281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcb21f-824e-45f6-8b47-57fb7cc3f1ca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.238656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.239555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.240000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.240460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] PATH_INFO: `/v3/users/6b21eb819fc548aeb9f9286f617f2691` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.241869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] RBAC: Authorizing `identity:get_user(user_id=6b21eb819fc548aeb9f9286f617f2691)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.243522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.245704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 120/229] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:45 2022] GET /identity/v3/users/6b21eb819fc548aeb9f9286f617f2691 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:45.253351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.313181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387cd82-147e-42b0-b339-f23fec7be6a2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.324626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:45.377040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.377686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.377972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.378253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] PATH_INFO: `/v3/users/6b21eb819fc548aeb9f9286f617f2691` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.380697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] RBAC: Authorizing `identity:get_user(user_id=6b21eb819fc548aeb9f9286f617f2691)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.382172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.387205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 110/230] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:45 2022] GET /identity/v3/users/6b21eb819fc548aeb9f9286f617f2691 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:45.389850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.430078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:45.431057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d385b1e-5cd5-4956-88cb-1185109ed14c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.473613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.474503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.474939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.475393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.476732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.478339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.480647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 121/231] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:45 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:45.490613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.607146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434697-3213-4c71-b8cf-d04bebe19a78 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.612680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:45.653044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1f76-224c-49e3-806b-a4bd629856b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.654970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1f76-224c-49e3-806b-a4bd629856b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.655406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1f76-224c-49e3-806b-a4bd629856b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.655931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1f76-224c-49e3-806b-a4bd629856b0 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/6b21eb819fc548aeb9f9286f617f2691/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.662808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf1f76-224c-49e3-806b-a4bd629856b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=45a590fc1d3148ad8f13ce4ed581eade, user_id=6b21eb819fc548aeb9f9286f617f2691, role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.666617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf1f76-224c-49e3-806b-a4bd629856b0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.683419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5f117-8420-4eec-b805-f38f67ac2c9a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.721483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.722491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.722923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.723343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.724665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.726417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.732308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 111/232] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:45 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:45.734516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:45.771737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 122/233] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:45 2022] PUT /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/6b21eb819fc548aeb9f9286f617f2691/roles/e06796d7090a468581574c96a6f9f18e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:45.848525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:45.858322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722792ae-9fb5-4905-8839-8959e7e71cf9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:45.899947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13422412-67e7-4113-bcba-5d38dc46289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:45.901038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422412-67e7-4113-bcba-5d38dc46289b None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:45.901472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422412-67e7-4113-bcba-5d38dc46289b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:45.901893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13422412-67e7-4113-bcba-5d38dc46289b None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/6b21eb819fc548aeb9f9286f617f2691/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:45.904260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13422412-67e7-4113-bcba-5d38dc46289b None admin] RBAC: Authorizing `identity:create_grant(project_id=45a590fc1d3148ad8f13ce4ed581eade, user_id=6b21eb819fc548aeb9f9286f617f2691, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:45.906047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13422412-67e7-4113-bcba-5d38dc46289b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:45.982154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 112/234] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:45 2022] PUT /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/6b21eb819fc548aeb9f9286f617f2691/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:46.004738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ccc45-0998-4904-8be8-93bbb62d70ec None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.005264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ccc45-0998-4904-8be8-93bbb62d70ec None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.005733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ccc45-0998-4904-8be8-93bbb62d70ec None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.007775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 123/235] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:46.013438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848573-c521-444f-bdc8-40ac2ebe3241 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.013731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848573-c521-444f-bdc8-40ac2ebe3241 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.014012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e848573-c521-444f-bdc8-40ac2ebe3241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.035357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1e848573-c521-444f-bdc8-40ac2ebe3241 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:46.036781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e848573-c521-444f-bdc8-40ac2ebe3241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:46.121442 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 113/236] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:46.138201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c186-261a-45fe-8196-2344c5666124 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.138503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c186-261a-45fe-8196-2344c5666124 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.138770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c186-261a-45fe-8196-2344c5666124 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.140132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 124/237] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:46.146387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fecd0-f1be-47c3-bdaf-709054004743 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.146684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fecd0-f1be-47c3-bdaf-709054004743 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.147004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fecd0-f1be-47c3-bdaf-709054004743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.167561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-844fecd0-f1be-47c3-bdaf-709054004743 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:46.168788 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-844fecd0-f1be-47c3-bdaf-709054004743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:46.259843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 114/238] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:46.425015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c186-261a-45fe-8196-2344c5666124 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.557026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c186-261a-45fe-8196-2344c5666124 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:46.606819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:46.607469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.607757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.608036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.614259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fecd0-f1be-47c3-bdaf-709054004743 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.622164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:46.627413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:46.628458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:46.629431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 125/239] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:09:46.632118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:46.636929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.681129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:46.745612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fecd0-f1be-47c3-bdaf-709054004743 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:46.779745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dffa5e-4382-4009-826b-3934897271b7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:46.785912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909bed-9dc8-49f0-bfa8-4b4ebf025484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:46.786818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909bed-9dc8-49f0-bfa8-4b4ebf025484 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.787320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909bed-9dc8-49f0-bfa8-4b4ebf025484 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.787791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909bed-9dc8-49f0-bfa8-4b4ebf025484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.789305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909bed-9dc8-49f0-bfa8-4b4ebf025484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:46.791225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909bed-9dc8-49f0-bfa8-4b4ebf025484 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:46.793087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 115/240] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:46.794432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c463-169c-4b62-8996-712adf369122 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.794917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c463-169c-4b62-8996-712adf369122 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.795402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c463-169c-4b62-8996-712adf369122 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.797242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 116/241] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:46.799406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c463-169c-4b62-8996-712adf369122 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.822662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5d17f-4947-4b64-ac08-db215f45f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:46.823324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d17f-4947-4b64-ac08-db215f45f553 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.823614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d17f-4947-4b64-ac08-db215f45f553 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.823894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d17f-4947-4b64-ac08-db215f45f553 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.824647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5d17f-4947-4b64-ac08-db215f45f553 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:46.824904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5d17f-4947-4b64-ac08-db215f45f553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:46.826568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5d17f-4947-4b64-ac08-db215f45f553 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:46.839962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 126/242] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:46.839962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79343-828c-48cb-aa66-490fe4de5f37 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.839962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79343-828c-48cb-aa66-490fe4de5f37 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.839962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79343-828c-48cb-aa66-490fe4de5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.857638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0da79343-828c-48cb-aa66-490fe4de5f37 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:46.858842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0da79343-828c-48cb-aa66-490fe4de5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:46.897710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:46.920846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c463-169c-4b62-8996-712adf369122 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:46.930810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 127/243] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:46.931526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da79343-828c-48cb-aa66-490fe4de5f37 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:46.951303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:46.961467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:46.962624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:46.963103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:46.966184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:46.966184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:46.966184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.039685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 117/244] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:09:46 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:47.050104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da79343-828c-48cb-aa66-490fe4de5f37 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.097256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.097950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.098242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.098519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] PATH_INFO: `/v3/users/ecf0bb579225435a8ccd49b289c9acab` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.119602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] RBAC: Authorizing `identity:get_user(user_id=ecf0bb579225435a8ccd49b289c9acab)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.121224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.127845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 128/245] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:46 2022] GET /identity/v3/users/ecf0bb579225435a8ccd49b289c9acab => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:47.133896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.288453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d4a5a-4cd9-4f28-a643-288d95fcc728 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.324987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.325608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.325891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.326169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.329803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:47.365297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.416351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.417841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.463782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:47.496869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562626f-36a0-4357-a04c-9012ca8cd81a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.538628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.539281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.539568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.539845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.545768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 118/246] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:47.551648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.557733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:47.564935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:47.565979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:47.567609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 129/247] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:47.572354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.592074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:47.668770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b69e80-91dc-4778-ba3f-e7dac7b35e0b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.700340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d69f6-af59-4fec-b9f6-ab80a5a87f56 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.710103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.710787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.711073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.711411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.713368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.715019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.716899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 119/248] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:47.723536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.741086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.741709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.742158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.742445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.743500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:47.743855 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.745656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.747713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:47.758588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 130/249] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:47.765189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:47.862604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d27f6-aa62-476a-8b52-5336e75ee732 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.867119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:47.905363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b3d2-edf6-40df-98ec-4db8fe4c079c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:47.905837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.906463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.906745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.907018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.907962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] RBAC: Adding query filter params (role.id=8530394e88764d83bf17527b2c8c18e2, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=ecf0bb579225435a8ccd49b289c9acab) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:47.908304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.909776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.917634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 120/250] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/role_assignments?user.id=ecf0bb579225435a8ccd49b289c9acab&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=8530394e88764d83bf17527b2c8c18e2 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:47.953169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:47.953844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:47.954126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:47.954403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] PATH_INFO: `/v3/users/590cf855ff054cd997e6480786913d90` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:47.955693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] RBAC: Authorizing `identity:get_user(user_id=590cf855ff054cd997e6480786913d90)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:47.957220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:47.958892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 131/251] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/users/590cf855ff054cd997e6480786913d90 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:47.964680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.091815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882159fc-71b9-423c-99b8-f004b2e38409 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.135736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa795920-41c4-41c1-8543-5261d407dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.136423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa795920-41c4-41c1-8543-5261d407dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.136709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa795920-41c4-41c1-8543-5261d407dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.136990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa795920-41c4-41c1-8543-5261d407dcc6 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.138174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa795920-41c4-41c1-8543-5261d407dcc6 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.139621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa795920-41c4-41c1-8543-5261d407dcc6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.141712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 121/252] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:47 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:48.149137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:48.252976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:48.263742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696eaa9-40d3-4b20-8050-ffc76f6362f2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.265735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696eaa9-40d3-4b20-8050-ffc76f6362f2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.265735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696eaa9-40d3-4b20-8050-ffc76f6362f2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.268330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 122/253] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:48.273385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b258d-c526-44ce-991a-6e91dc1fd06e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.273947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b258d-c526-44ce-991a-6e91dc1fd06e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.274421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b258d-c526-44ce-991a-6e91dc1fd06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.298888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1b6b258d-c526-44ce-991a-6e91dc1fd06e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:48.300647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1b6b258d-c526-44ce-991a-6e91dc1fd06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:48.332059 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec75a-7ad3-41bf-9c3e-e33edb78a84a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:48.375701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:48.429983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:48.430784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.431072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.431336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/590cf855ff054cd997e6480786913d90/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.433380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] RBAC: Authorizing `identity:create_grant(project_id=45a590fc1d3148ad8f13ce4ed581eade, user_id=590cf855ff054cd997e6480786913d90, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:48.435229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:48.459051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 123/254] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:48.512739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02af16-d64a-4ee5-82f1-ebf0af17ac89 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.512739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02af16-d64a-4ee5-82f1-ebf0af17ac89 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.512739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02af16-d64a-4ee5-82f1-ebf0af17ac89 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.512739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 124/255] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:48.517388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec000e5-e2cb-4055-b744-8a6b3ea0b380 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:48.517686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec000e5-e2cb-4055-b744-8a6b3ea0b380 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:48.517970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec000e5-e2cb-4055-b744-8a6b3ea0b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:48.521983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 132/256] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:48 2022] PUT /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/590cf855ff054cd997e6480786913d90/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:48.538551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5ec000e5-e2cb-4055-b744-8a6b3ea0b380 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:48.543295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ec000e5-e2cb-4055-b744-8a6b3ea0b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:48.629063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 125/257] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:48.951817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.072334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f825-06f6-4d5b-8d1a-e3b20d4037fc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:49.103798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:49.114808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:49.115457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:49.115744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:49.116021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:49.134832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:49.140481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec000e5-e2cb-4055-b744-8a6b3ea0b380 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:49.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:49.145517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:09:49.146301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:49.152201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 133/258] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:09:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:49.159582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.308175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:49.322381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec000e5-e2cb-4055-b744-8a6b3ea0b380 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:49.369159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c898-4207-418d-8bb1-d534325ddcfe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:49.400630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:49.401343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:49.401631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:49.401909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:49.420629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:49.426377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:49.427267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:49.428046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 126/259] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:09:49.431681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:49.432333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:49.432617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:49.432893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:49.433568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:49.433873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:49.435278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:49.437572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.453553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 134/260] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:49.454240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.544563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:49.624794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fdd33-ca5e-401e-8d84-d01d308b00c2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:49.640365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb91d-18cb-4ddb-bef8-ad4a63bc8c24 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:49.691811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:49.692458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:49.692738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:49.693014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:49.694433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:49.694744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:49.696840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:49.706541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:49.707197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:49.707480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:49.707757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] PATH_INFO: `/v3/users/6b21eb819fc548aeb9f9286f617f2691` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:49.710385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] RBAC: Authorizing `identity:get_user(user_id=6b21eb819fc548aeb9f9286f617f2691)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:49.713277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:49.716723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 127/261] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:49.718207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 135/262] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/users/6b21eb819fc548aeb9f9286f617f2691 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:49.727068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.728190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:49.782493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:49.914014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b42c4-c896-44be-a126-9203d7866174 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:49.949989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:49.950629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:49.950912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:49.951192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] PATH_INFO: `/v3/users/6b21eb819fc548aeb9f9286f617f2691` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:49.952426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] RBAC: Authorizing `identity:get_user(user_id=6b21eb819fc548aeb9f9286f617f2691)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:49.953926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:49.956451 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 128/263] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/users/6b21eb819fc548aeb9f9286f617f2691 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:49.965142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:50.014115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40284263-c218-4946-9f4e-6a72779f5f12 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:50.057386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:50.092856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:50.099947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:50.100615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.100909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.101192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.119872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf87f5-20df-4bfc-8c03-243dad811d6e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:50.185099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:50.186428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.186959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.187373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.263314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:50.264843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:50.335509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:50.337132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:50.405717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 136/264] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:50.407459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:50.424038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:50.452773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:50.474782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 129/265] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:50.480731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:50.516868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fe031-ed80-411d-8ccc-d94b1ea43015 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:50.554677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:50.555295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.555581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.556011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.557282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:50.558862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:50.564655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 137/266] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:50 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:50.567831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:50.590980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c018fd-d948-47e8-a747-9e269a3e6df8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:50.629543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2cfe1-66bf-4202-adc1-b46ab77dbb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:50.630530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2cfe1-66bf-4202-adc1-b46ab77dbb65 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.631017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2cfe1-66bf-4202-adc1-b46ab77dbb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.631535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2cfe1-66bf-4202-adc1-b46ab77dbb65 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.632902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2cfe1-66bf-4202-adc1-b46ab77dbb65 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:50.634640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2cfe1-66bf-4202-adc1-b46ab77dbb65 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:50.636812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 130/267] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:50 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:50.638153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faf5d-a8fa-4d65-9a77-2eb2e9786eef None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.638651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faf5d-a8fa-4d65-9a77-2eb2e9786eef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.639134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faf5d-a8fa-4d65-9a77-2eb2e9786eef None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.645732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 131/268] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:50.646847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2faf5d-a8fa-4d65-9a77-2eb2e9786eef None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:50.656636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:50.678144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b430-c3ad-49bf-b3ef-e3e9f9e0a48a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:50.709963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:50.716288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ac1e-3583-4c27-8398-8c40b9801bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:50.717080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ac1e-3583-4c27-8398-8c40b9801bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.717364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ac1e-3583-4c27-8398-8c40b9801bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.717689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ac1e-3583-4c27-8398-8c40b9801bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.730311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ac1e-3583-4c27-8398-8c40b9801bd1 None admin] RBAC: Adding query filter params (role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=6b21eb819fc548aeb9f9286f617f2691) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:50.730311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ac1e-3583-4c27-8398-8c40b9801bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:50.730311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ac1e-3583-4c27-8398-8c40b9801bd1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:50.730311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 138/269] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:50 2022] GET /identity/v3/role_assignments?user.id=6b21eb819fc548aeb9f9286f617f2691&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=e06796d7090a468581574c96a6f9f18e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:50.731621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541400d-82e9-4ae0-8fb0-2a82d5c7a586 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.731909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541400d-82e9-4ae0-8fb0-2a82d5c7a586 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.732185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541400d-82e9-4ae0-8fb0-2a82d5c7a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.762819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2faf5d-a8fa-4d65-9a77-2eb2e9786eef None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:50.769540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4541400d-82e9-4ae0-8fb0-2a82d5c7a586 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:50.770832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4541400d-82e9-4ae0-8fb0-2a82d5c7a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:50.803358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69151e-975a-4484-8acf-b32103b69ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:50.804425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69151e-975a-4484-8acf-b32103b69ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:50.804913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69151e-975a-4484-8acf-b32103b69ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:50.805390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69151e-975a-4484-8acf-b32103b69ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:50.806336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69151e-975a-4484-8acf-b32103b69ef3 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=6b21eb819fc548aeb9f9286f617f2691) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:50.807038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69151e-975a-4484-8acf-b32103b69ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:50.808728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69151e-975a-4484-8acf-b32103b69ef3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:50.820330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 132/270] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:50 2022] GET /identity/v3/role_assignments?user.id=6b21eb819fc548aeb9f9286f617f2691&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:50.883222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 139/271] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:51.043734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828004f8-b4ea-4f6c-ba71-30eb057a5034 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.044070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828004f8-b4ea-4f6c-ba71-30eb057a5034 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.044322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828004f8-b4ea-4f6c-ba71-30eb057a5034 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.045999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 133/272] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:51.052639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cef26-ad19-4f0d-a5cc-49aa53d7f5b6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.052932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cef26-ad19-4f0d-a5cc-49aa53d7f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.053199 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cef26-ad19-4f0d-a5cc-49aa53d7f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.073929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2c9cef26-ad19-4f0d-a5cc-49aa53d7f5b6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:51.075106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2c9cef26-ad19-4f0d-a5cc-49aa53d7f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:51.150191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 140/273] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:51.212071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee5a61-1f57-4261-9d85-3819597975bc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.212605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee5a61-1f57-4261-9d85-3819597975bc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.212847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee5a61-1f57-4261-9d85-3819597975bc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.214471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 134/274] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:51.219665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0fbe-6b60-45d0-9d8d-9100bc96e2d8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.220325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0fbe-6b60-45d0-9d8d-9100bc96e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.221462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec0fbe-6b60-45d0-9d8d-9100bc96e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.238301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:51.244072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-28ec0fbe-6b60-45d0-9d8d-9100bc96e2d8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:51.245315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-28ec0fbe-6b60-45d0-9d8d-9100bc96e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:51.280143 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee5a61-1f57-4261-9d85-3819597975bc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:51.334296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 141/275] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:51.408954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee5a61-1f57-4261-9d85-3819597975bc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:51.429739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:51.450238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:51.451067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.451402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.451737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.463765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:51.468691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:51.469544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:51.471225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 135/276] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:51.476340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec0fbe-6b60-45d0-9d8d-9100bc96e2d8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:51.509257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:51.597980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec0fbe-6b60-45d0-9d8d-9100bc96e2d8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:51.632668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677978f-8857-440e-afdc-61775564b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:51.633274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677978f-8857-440e-afdc-61775564b12a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.633554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677978f-8857-440e-afdc-61775564b12a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.633829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677978f-8857-440e-afdc-61775564b12a None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.634496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677978f-8857-440e-afdc-61775564b12a None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:51.634797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677978f-8857-440e-afdc-61775564b12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:51.636460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677978f-8857-440e-afdc-61775564b12a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:51.637022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ab69-ff67-4058-a93c-e4dcde62dca9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:51.638601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:51.645897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 142/277] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:51.647071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161fc8f-c4bb-4703-ab69-e97aeb73a6d2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.647355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161fc8f-c4bb-4703-ab69-e97aeb73a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.652905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161fc8f-c4bb-4703-ab69-e97aeb73a6d2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.652905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 143/278] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:51.652905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161fc8f-c4bb-4703-ab69-e97aeb73a6d2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:51.674630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:51.675267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.675547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.675823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.676957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:51.678441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:51.680007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 136/279] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:51.680793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:51.728577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:51.758646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161fc8f-c4bb-4703-ab69-e97aeb73a6d2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:51.781746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ece811-9e91-4a45-a734-29294b4fc3ce None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:51.791994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f8c51-04c6-429f-a6de-e00492ff115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:51.792664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8c51-04c6-429f-a6de-e00492ff115f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.792941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8c51-04c6-429f-a6de-e00492ff115f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.793215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8c51-04c6-429f-a6de-e00492ff115f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.804100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f8c51-04c6-429f-a6de-e00492ff115f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-257f8c51-04c6-429f-a6de-e00492ff115f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:51.808806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:51.809892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 144/280] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:51.816309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b8db-adf8-4e14-af25-6a42532b9432 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.817019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b8db-adf8-4e14-af25-6a42532b9432 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.817019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345b8db-adf8-4e14-af25-6a42532b9432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.817133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:51.817634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.817850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.818124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] PATH_INFO: `/v3/users/a590bd6ed03c421e84a9a03d90ed6fc6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.829359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c345b8db-adf8-4e14-af25-6a42532b9432 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:51.830653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c345b8db-adf8-4e14-af25-6a42532b9432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:51.832030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] RBAC: Authorizing `identity:get_user(user_id=a590bd6ed03c421e84a9a03d90ed6fc6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:51.833530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:51.835147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 137/281] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:51 2022] GET /identity/v3/users/a590bd6ed03c421e84a9a03d90ed6fc6 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:51.837803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:51.886549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:51.900033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 145/282] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:51.900712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345b8db-adf8-4e14-af25-6a42532b9432 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:51.938559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd754d08-0798-455e-b4df-5aeedc38ca13 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:51.942525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:51.974474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937180a7-566c-4662-a593-a8480c382939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:51.975084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937180a7-566c-4662-a593-a8480c382939 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:51.975365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937180a7-566c-4662-a593-a8480c382939 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:51.975639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937180a7-566c-4662-a593-a8480c382939 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:51.976399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937180a7-566c-4662-a593-a8480c382939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:51.978444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937180a7-566c-4662-a593-a8480c382939 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.005812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345b8db-adf8-4e14-af25-6a42532b9432 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.039093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.039699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.039983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.040638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.041311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:52.041620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:52.042988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.051728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 146/283] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:52.056392 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:52.074323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 138/284] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:09:51 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:52.075298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937180a7-566c-4662-a593-a8480c382939 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:52.134614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:52.198823 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09c04-3ee7-4c46-a076-cbd9060a5f49 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.215187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937180a7-566c-4662-a593-a8480c382939 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.241349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.242310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.242310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.242535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.243259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, user.id=a590bd6ed03c421e84a9a03d90ed6fc6, scope.system=all) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:52.243587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:52.245052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.251036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 147/285] 10.222.0.86 () {56 vars in 1308 bytes} [Thu Aug 18 11:09:52 2022] GET /identity/v3/role_assignments?user.id=a590bd6ed03c421e84a9a03d90ed6fc6&scope.system=all&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:52.256420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:52.268193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.268193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.268193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.268193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] PATH_INFO: `/v3/users/ecf0bb579225435a8ccd49b289c9acab` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.270111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] RBAC: Authorizing `identity:get_user(user_id=ecf0bb579225435a8ccd49b289c9acab)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:52.271638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.273631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 139/286] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:52 2022] GET /identity/v3/users/ecf0bb579225435a8ccd49b289c9acab => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:52.279646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:52.324679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:52.406346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3dbd-543f-4837-a5c7-f685cf5ebf57 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.424986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:52.428564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d2aa-cc4c-496c-9a15-78980b101078 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.456416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.456929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.457215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.457496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.471882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:52.472809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71774-6415-4209-9466-387478f8839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.473661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71774-6415-4209-9466-387478f8839a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.474126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71774-6415-4209-9466-387478f8839a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.474578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71774-6415-4209-9466-387478f8839a None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.475944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71774-6415-4209-9466-387478f8839a None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:52.476962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:52.477884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:52.478678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:52.480558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 148/287] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:52.480665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71774-6415-4209-9466-387478f8839a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.482854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 140/288] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:52 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:52.484088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:52.490701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71774-6415-4209-9466-387478f8839a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:52.607668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:52.614596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71774-6415-4209-9466-387478f8839a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.625519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07693a6-3be5-4bb8-bb18-8b159ad79e47 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.651002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.651672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.651955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.652250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/ecf0bb579225435a8ccd49b289c9acab/roles/8530394e88764d83bf17527b2c8c18e2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.654469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=45a590fc1d3148ad8f13ce4ed581eade, user_id=ecf0bb579225435a8ccd49b289c9acab, role_id=8530394e88764d83bf17527b2c8c18e2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:52.655736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.668708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.669327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.669612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.674040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.674040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:52.674040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:52.674040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.682796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 149/289] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:52.689844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:52.737995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:52.738618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 141/290] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:09:52 2022] PUT /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/users/ecf0bb579225435a8ccd49b289c9acab/roles/8530394e88764d83bf17527b2c8c18e2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:09:52.838835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18288ed7-8bf1-4b6e-ad0d-6cb7cf9bbadc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:52.888962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:52.889616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:52.889903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:52.890183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] PATH_INFO: `/v3/users/590cf855ff054cd997e6480786913d90` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:52.891401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] RBAC: Authorizing `identity:get_user(user_id=590cf855ff054cd997e6480786913d90)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:52.893391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:52.895020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 150/291] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:52 2022] GET /identity/v3/users/590cf855ff054cd997e6480786913d90 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:52.900922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:53.016994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d03e0-e85f-4f12-8d28-a527c01a7ac8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:53.053469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:53.054082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:53.054362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:53.054637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:53.081067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:53.125997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:53.127546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:53.231134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 142/292] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:53.237412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:53.363731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1b8a-e573-4f31-a62a-e9a99dd545fd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:53.369324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:53.404040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c48fbf-db78-4872-98cf-6b33c7b6b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:53.404695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c48fbf-db78-4872-98cf-6b33c7b6b063 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:53.404971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c48fbf-db78-4872-98cf-6b33c7b6b063 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:53.405240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c48fbf-db78-4872-98cf-6b33c7b6b063 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:53.406344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c48fbf-db78-4872-98cf-6b33c7b6b063 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:53.408360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c48fbf-db78-4872-98cf-6b33c7b6b063 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:53.410133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 151/293] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:53 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:53.416417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:53.475468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:53.520507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a1289-e98a-43ee-8db2-4cb2f066dd18 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:53.557440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca4da2-a141-416b-9538-b429a396e90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:53.558052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4da2-a141-416b-9538-b429a396e90b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:53.558333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4da2-a141-416b-9538-b429a396e90b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:53.558608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4da2-a141-416b-9538-b429a396e90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:53.559345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca4da2-a141-416b-9538-b429a396e90b None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=590cf855ff054cd997e6480786913d90) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:53.559653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca4da2-a141-416b-9538-b429a396e90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:53.561162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca4da2-a141-416b-9538-b429a396e90b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:53.568205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 143/294] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:53 2022] GET /identity/v3/role_assignments?user.id=590cf855ff054cd997e6480786913d90&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:54.474387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc5803-f5c8-45e5-a4a4-b062105835e4 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.475353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc5803-f5c8-45e5-a4a4-b062105835e4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.475828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc5803-f5c8-45e5-a4a4-b062105835e4 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.477650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 152/295] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:54.483300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6319e-8ca6-4589-bdb4-2f1e873f580e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.484120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6319e-8ca6-4589-bdb4-2f1e873f580e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.484638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6319e-8ca6-4589-bdb4-2f1e873f580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.504008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fef6319e-8ca6-4589-bdb4-2f1e873f580e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:54.505619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fef6319e-8ca6-4589-bdb4-2f1e873f580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.576541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 144/296] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:54.686731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771ede6-5332-45cb-b942-27a943c5a807 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.687077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771ede6-5332-45cb-b942-27a943c5a807 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.687285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771ede6-5332-45cb-b942-27a943c5a807 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.689729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 153/297] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:54.695153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eed0ed-63e1-463b-ae9f-773bcd45422c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.695612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eed0ed-63e1-463b-ae9f-773bcd45422c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.696056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eed0ed-63e1-463b-ae9f-773bcd45422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.714959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-56eed0ed-63e1-463b-ae9f-773bcd45422c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:54.716130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-56eed0ed-63e1-463b-ae9f-773bcd45422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.720041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a3a0d-6128-4f61-a44a-f97ec7546ea7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.720560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a3a0d-6128-4f61-a44a-f97ec7546ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.721043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a3a0d-6128-4f61-a44a-f97ec7546ea7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.722375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 154/298] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:54.727485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15fcd-e484-4cfb-96bc-18abc9d4e9fb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.727704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15fcd-e484-4cfb-96bc-18abc9d4e9fb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.727988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15fcd-e484-4cfb-96bc-18abc9d4e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.746568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e7f15fcd-e484-4cfb-96bc-18abc9d4e9fb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:54.747755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e7f15fcd-e484-4cfb-96bc-18abc9d4e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:54.765670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:54.787243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 145/299] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:54.818139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 155/300] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:54.866085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eed0ed-63e1-463b-ae9f-773bcd45422c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:54.932291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c381c4-40bf-4108-8863-d1af6123f47a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.932585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c381c4-40bf-4108-8863-d1af6123f47a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.932868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c381c4-40bf-4108-8863-d1af6123f47a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.934475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 156/301] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:54.939923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b584a3b-8316-4472-801f-ab4e56ef70f2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:54.940203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b584a3b-8316-4472-801f-ab4e56ef70f2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:54.940506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b584a3b-8316-4472-801f-ab4e56ef70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:54.960441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5b584a3b-8316-4472-801f-ab4e56ef70f2 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:54.962080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5b584a3b-8316-4472-801f-ab4e56ef70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:55.005613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eed0ed-63e1-463b-ae9f-773bcd45422c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.037712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 157/302] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:55.044748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.044748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.044748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.044748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.055920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:55.060821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:55.061673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:55.062448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 146/303] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:55.065348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b584a3b-8316-4472-801f-ab4e56ef70f2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.071532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.102555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.118693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.174504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b584a3b-8316-4472-801f-ab4e56ef70f2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.182857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba13ea-14c6-40c0-9f10-b82039b627a6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.212313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.212951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.213233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.213679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.221036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.221900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.222313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.222775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.223599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:55.224051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.225470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.229510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:55.239420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 147/304] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:55.239588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:55.240435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:55.241211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:55.241801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.241866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 158/305] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:55.241866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.336949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.346065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb4d5b-6c00-4adb-aa40-0102f47cc33a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.346803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be2983-bf25-4b67-ab0a-171fabdfa99c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.349093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.380964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.381262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.381601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.381884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.381974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.382160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.382264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.382433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] PATH_INFO: `/v3/users/a590bd6ed03c421e84a9a03d90ed6fc6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.383259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.383529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] RBAC: Authorizing `identity:get_user(user_id=a590bd6ed03c421e84a9a03d90ed6fc6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.384743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.385232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.386536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 148/306] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:55.386870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 159/307] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/users/a590bd6ed03c421e84a9a03d90ed6fc6 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:55.387127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.389066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.487973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba8bc-dc1a-4fb6-9ac0-c46354ec5a0b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.490144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8592c6e-8f89-4871-ad01-1e416996cb1a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.521645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.522253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.522532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.522806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.523470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:55.523774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.523860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.524430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.524714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.524984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.525309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.533726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 149/308] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:55.534566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.535900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:55.540832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:55.541738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:55.542523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 160/309] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:55.543164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.565330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.567787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.635483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad3415-24ad-4570-b691-d760ac5c85ae None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.641205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326935c-4db6-4aac-9ec2-c21f4633ce30 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.669869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.670477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.670755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.671033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] PATH_INFO: `/v3/groups` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.671655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.673783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.676152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.676821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.677102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.677378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] PATH_INFO: `/v3/system/users/a590bd6ed03c421e84a9a03d90ed6fc6/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.678789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a590bd6ed03c421e84a9a03d90ed6fc6, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.680139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.755023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 150/310] 10.222.0.86 () {60 vars in 1134 bytes} [Thu Aug 18 11:09:55 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:09:55.755858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.788544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 161/311] 10.222.0.86 () {58 vars in 1334 bytes} [Thu Aug 18 11:09:55 2022] PUT /identity/v3/system/users/a590bd6ed03c421e84a9a03d90ed6fc6/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:09:55.788544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.894539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.906596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:55.916868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557935fa-f948-4aa1-a3b7-9803ff43e787 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.922586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f038fc-8cbe-4708-b69e-426f33021f17 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:55.964601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.965230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.965572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.965847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.966527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:55.966833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.968334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.971366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:55.972420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:55.972707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:55.972983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] PATH_INFO: `/v3/users/a487a92974fc4b76aa6feebb321ae22b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:55.978984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 162/312] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:55.984639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:55.994352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] RBAC: Authorizing `identity:get_user(user_id=a487a92974fc4b76aa6feebb321ae22b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:55.995860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:55.997584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 151/313] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/users/a487a92974fc4b76aa6feebb321ae22b => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:56.004311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:56.128785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8100e-b884-4b3c-af5e-2ddc9161660f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:56.129804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0a65-4e70-4757-9dd1-dc8289fa2403 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:56.173597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:56.174213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:56.174497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:56.174861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:56.175598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] RBAC: Adding query filter params (role.id=8530394e88764d83bf17527b2c8c18e2, user.id=a487a92974fc4b76aa6feebb321ae22b, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:56.175911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:56.177449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:56.178801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:56.179920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:56.180590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:56.180872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] PATH_INFO: `/v3/users/ecf0bb579225435a8ccd49b289c9acab` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:56.182100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] RBAC: Authorizing `identity:get_user(user_id=ecf0bb579225435a8ccd49b289c9acab)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:56.183475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:56.184405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 152/314] 10.222.0.86 () {56 vars in 1308 bytes} [Thu Aug 18 11:09:56 2022] GET /identity/v3/role_assignments?user.id=a487a92974fc4b76aa6feebb321ae22b&scope.system=all&role.id=8530394e88764d83bf17527b2c8c18e2 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:56.197937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 163/315] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:55 2022] GET /identity/v3/users/ecf0bb579225435a8ccd49b289c9acab => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:56.199519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:56.218876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:56.321903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220582-cb5e-4028-910f-e2e20e47c12a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:56.367168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:56.367785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:56.368066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:56.368386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:56.439004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:56.440418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:56.456621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:56.545805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 153/316] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:09:56.552194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:56.573122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:56.662879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d976-eca2-4161-9451-a1f70c6896bc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:56.700944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae8ac6-5ab4-4b66-acc5-aa7cdb7506a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:56.701500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8ac6-5ab4-4b66-acc5-aa7cdb7506a4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:56.701784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8ac6-5ab4-4b66-acc5-aa7cdb7506a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:56.702062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8ac6-5ab4-4b66-acc5-aa7cdb7506a4 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:56.703190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae8ac6-5ab4-4b66-acc5-aa7cdb7506a4 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:56.705339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae8ac6-5ab4-4b66-acc5-aa7cdb7506a4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:56.707464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 164/317] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:09:56 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:56.713270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:56.820187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b983f59-4628-4571-b4ec-5a377217f96e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:56.835418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:56.857238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972d831-2437-4486-b18d-0d57abf0ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:56.857861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d831-2437-4486-b18d-0d57abf0ce89 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:56.858142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d831-2437-4486-b18d-0d57abf0ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:56.858415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972d831-2437-4486-b18d-0d57abf0ce89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:56.869246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972d831-2437-4486-b18d-0d57abf0ce89 None admin] RBAC: Adding query filter params (role.id=8530394e88764d83bf17527b2c8c18e2, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade, user.id=ecf0bb579225435a8ccd49b289c9acab) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:56.869246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972d831-2437-4486-b18d-0d57abf0ce89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:56.869246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972d831-2437-4486-b18d-0d57abf0ce89 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:56.869246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 154/318] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:09:56 2022] GET /identity/v3/role_assignments?user.id=ecf0bb579225435a8ccd49b289c9acab&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=8530394e88764d83bf17527b2c8c18e2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:57.774711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d3c4-3c4d-4225-8431-baef43eb486a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.833216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d3c4-3c4d-4225-8431-baef43eb486a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.833216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d3c4-3c4d-4225-8431-baef43eb486a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.833216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 165/319] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:09:57.833525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c024052-4653-4a74-96e5-0188cfcc3310 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.833525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c024052-4653-4a74-96e5-0188cfcc3310 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.833525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c024052-4653-4a74-96e5-0188cfcc3310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.833525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4c024052-4653-4a74-96e5-0188cfcc3310 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:57.833525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c024052-4653-4a74-96e5-0188cfcc3310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.845919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efddb8c-6f52-475b-a41d-c6400ef1fa74 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.846196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efddb8c-6f52-475b-a41d-c6400ef1fa74 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.846659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efddb8c-6f52-475b-a41d-c6400ef1fa74 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.848124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 166/320] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:57.853404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876fde5-d340-44a6-a205-104767aeac5a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:57.853908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876fde5-d340-44a6-a205-104767aeac5a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:57.854342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876fde5-d340-44a6-a205-104767aeac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:57.872997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2876fde5-d340-44a6-a205-104767aeac5a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:57.874420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2876fde5-d340-44a6-a205-104767aeac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:57.882901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 155/321] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:09:57.945617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 167/322] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:58.150809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c024052-4653-4a74-96e5-0188cfcc3310 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.175156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6571-29e8-460f-b0c3-ef152e51e433 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.175447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6571-29e8-460f-b0c3-ef152e51e433 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.175728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6571-29e8-460f-b0c3-ef152e51e433 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.177099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 168/323] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:09:58.182210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbf8f5-2779-4701-9408-d55970d345f7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.182504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbf8f5-2779-4701-9408-d55970d345f7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.182783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbf8f5-2779-4701-9408-d55970d345f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.200476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-72cbf8f5-2779-4701-9408-d55970d345f7 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:09:58.201663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-72cbf8f5-2779-4701-9408-d55970d345f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:09:58.209340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.266523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c024052-4653-4a74-96e5-0188cfcc3310 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.272790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 169/324] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:09:58.273632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbf8f5-2779-4701-9408-d55970d345f7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.276043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.304425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.305071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.305400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.305930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.317522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:58.322310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:58.323235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:09:58.324042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 156/325] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:58.329129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.383498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbf8f5-2779-4701-9408-d55970d345f7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.418542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.419093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.419370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.419639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.420750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.422181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.424140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 170/326] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:58.429534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.438861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad95c3-d7e5-4e44-bada-e8454cbcea1f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.442125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.476660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.477392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.477675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.477950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.478621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:58.478952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.480590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.493555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 157/327] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:58.494501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.527207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.537132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555febf-e57a-4688-b229-4c18b261ba75 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.570821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.571427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.571704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.571976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] PATH_INFO: `/v3/groups` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.572631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.574054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.598827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18579506-9275-402c-8b0b-96aced9d1eaa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.631828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.632488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.632771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.633044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] PATH_INFO: `/v3/users/a590bd6ed03c421e84a9a03d90ed6fc6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.633731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 171/328] 10.222.0.86 () {60 vars in 1134 bytes} [Thu Aug 18 11:09:58 2022] POST /identity/v3/groups => generated 226 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:09:58.634149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] RBAC: Authorizing `identity:get_user(user_id=a590bd6ed03c421e84a9a03d90ed6fc6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.634542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.635658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.637568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 158/329] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/users/a590bd6ed03c421e84a9a03d90ed6fc6 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:58.645320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.721798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.757571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d77a-9851-4031-bbfa-8e181230b0de None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.764514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:58.768945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f364b-7083-4b9d-b772-477d4189c155 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.800603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.801470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.801680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.801967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.812438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:58.813066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:58.813351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:58.814825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:58.815009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] RBAC: Adding query filter params (role.id=7e46fd9311c848bb8730f41e91ba92ea, user.id=a590bd6ed03c421e84a9a03d90ed6fc6, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:58.815289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:58.816709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:09:58.816853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:09:58.822005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:09:58.822883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:09:58.823833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 172/330] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:09:58.828859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:58.836343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 159/331] 10.222.0.86 () {56 vars in 1308 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/role_assignments?user.id=a590bd6ed03c421e84a9a03d90ed6fc6&scope.system=all&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:58.964530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ccfd3-b1ee-47a1-9ad0-d9e45e906c73 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:58.998570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:09:59.005658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.006510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.006955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.007386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.008236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:09:59.008629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.010019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.021214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 173/332] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:09:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:09:59.026744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.135647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796f669-d6f4-4ab0-87af-6fe83909a9c8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.174564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8b8a4-b72c-4d69-8e7d-8aff9c9d3c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.175229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8b8a4-b72c-4d69-8e7d-8aff9c9d3c09 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.175507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8b8a4-b72c-4d69-8e7d-8aff9c9d3c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.175782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8b8a4-b72c-4d69-8e7d-8aff9c9d3c09 None admin] PATH_INFO: `/v3/users/a487a92974fc4b76aa6feebb321ae22b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.176981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8b8a4-b72c-4d69-8e7d-8aff9c9d3c09 None admin] RBAC: Authorizing `identity:get_user(user_id=a487a92974fc4b76aa6feebb321ae22b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.178425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8b8a4-b72c-4d69-8e7d-8aff9c9d3c09 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.180331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 160/333] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:09:59 2022] GET /identity/v3/users/a487a92974fc4b76aa6feebb321ae22b => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:09:59.185839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:09:59.314249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf379-3b1c-47cf-8f18-ec02113640a2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:09:59.351447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e0c4-4ec5-4666-b6f3-3a3c3ab90430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:09:59.352105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e0c4-4ec5-4666-b6f3-3a3c3ab90430 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:09:59.352418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e0c4-4ec5-4666-b6f3-3a3c3ab90430 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:09:59.352697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e0c4-4ec5-4666-b6f3-3a3c3ab90430 None admin] PATH_INFO: `/v3/system/users/a487a92974fc4b76aa6feebb321ae22b/roles/8530394e88764d83bf17527b2c8c18e2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:09:59.354120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e0c4-4ec5-4666-b6f3-3a3c3ab90430 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a487a92974fc4b76aa6feebb321ae22b, role_id=8530394e88764d83bf17527b2c8c18e2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:09:59.355510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e0c4-4ec5-4666-b6f3-3a3c3ab90430 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:09:59.433338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 174/334] 10.222.0.86 () {58 vars in 1334 bytes} [Thu Aug 18 11:09:59 2022] PUT /identity/v3/system/users/a487a92974fc4b76aa6feebb321ae22b/roles/8530394e88764d83bf17527b2c8c18e2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:00.800776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72f52-33d3-4b84-b09c-9ec35690909b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:00.801387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72f52-33d3-4b84-b09c-9ec35690909b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:00.801387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba72f52-33d3-4b84-b09c-9ec35690909b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:00.802963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 161/335] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:00.808006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0b42-7db1-4ac5-940b-f7735597bedb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:00.808444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0b42-7db1-4ac5-940b-f7735597bedb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:00.808631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0b42-7db1-4ac5-940b-f7735597bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:00.833221 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-dabb0b42-7db1-4ac5-940b-f7735597bedb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:00.843689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dabb0b42-7db1-4ac5-940b-f7735597bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:00.894880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:00.912274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 175/336] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:01.384123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72f52-33d3-4b84-b09c-9ec35690909b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:01.413535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:01.485154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bb122-125a-4a7b-9fd8-e9505843fe91 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:01.486518 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bb122-125a-4a7b-9fd8-e9505843fe91 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:01.487217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bb122-125a-4a7b-9fd8-e9505843fe91 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:01.494404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 176/337] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:01.504822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb81c1-e9c5-41ca-8728-3a5f899bd86a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:01.505668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb81c1-e9c5-41ca-8728-3a5f899bd86a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:01.506439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb81c1-e9c5-41ca-8728-3a5f899bd86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:01.514028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba72f52-33d3-4b84-b09c-9ec35690909b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:01.549733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7fdb81c1-e9c5-41ca-8728-3a5f899bd86a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:01.554270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7fdb81c1-e9c5-41ca-8728-3a5f899bd86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:01.617783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:01.618510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:01.618785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:01.619053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:01.638336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:01.644374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:01.645949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:01.647530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 162/338] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:01.664465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:01.694238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 177/339] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:10:01.786611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:01.809797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936ca1a-3110-4e1e-874f-bd9027074500 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:01.852670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919e578-58aa-4425-8bab-f69340c4620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:01.853298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e578-58aa-4425-8bab-f69340c4620c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:01.853586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e578-58aa-4425-8bab-f69340c4620c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:01.853857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e578-58aa-4425-8bab-f69340c4620c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:01.854537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919e578-58aa-4425-8bab-f69340c4620c None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:01.854838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919e578-58aa-4425-8bab-f69340c4620c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:01.856392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919e578-58aa-4425-8bab-f69340c4620c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:01.868637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 163/340] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:10:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:01.876521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb81c1-e9c5-41ca-8728-3a5f899bd86a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:02.105063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb81c1-e9c5-41ca-8728-3a5f899bd86a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:02.119450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004015cc-d2a0-45bb-b973-11d35eb94045 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:02.119845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004015cc-d2a0-45bb-b973-11d35eb94045 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:02.120081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004015cc-d2a0-45bb-b973-11d35eb94045 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:02.121610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 164/341] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:02.128778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47b267-6d96-4343-a347-43040e92ff96 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:02.129106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47b267-6d96-4343-a347-43040e92ff96 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:02.129340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47b267-6d96-4343-a347-43040e92ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:02.146531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:02.169037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4d47b267-6d96-4343-a347-43040e92ff96 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:02.170229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d47b267-6d96-4343-a347-43040e92ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:02.218019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:02.219067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:02.219589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:02.220651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:02.393980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 165/342] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:10:02.423026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:02.425761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:02.455340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47b267-6d96-4343-a347-43040e92ff96 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:02.656658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:02.686574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47b267-6d96-4343-a347-43040e92ff96 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:02.694666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 178/343] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:02.700387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:02.725109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:02.748967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:02.749637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:02.749927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:02.750212 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:02.770182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:02.791588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:02.792599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:02.793380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 166/344] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:02.798713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:02.831588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44133ed9-b492-479e-a5ee-02403fd81783 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:02.871676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:02.872734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:02.873236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:02.873707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:02.875192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:02.877950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:02.880570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 179/345] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:02 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:02.886486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:02.958275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68afa7-b4ae-4fe1-90a4-8010d9a9a394 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:02.985947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.006104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62479c45-7657-4f72-8fd8-4d4fceaad1ed None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.013429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c000a-4a92-4806-9d4a-133371ff1f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.014083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c000a-4a92-4806-9d4a-133371ff1f6e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.014631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c000a-4a92-4806-9d4a-133371ff1f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.015112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c000a-4a92-4806-9d4a-133371ff1f6e None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.016103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c000a-4a92-4806-9d4a-133371ff1f6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:03.016688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c000a-4a92-4806-9d4a-133371ff1f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:03.018317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c000a-4a92-4806-9d4a-133371ff1f6e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:03.024569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.029267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 167/346] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:03.030760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee8d7-44d9-4f66-bf20-c179efe031e8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.031268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee8d7-44d9-4f66-bf20-c179efe031e8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.031747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee8d7-44d9-4f66-bf20-c179efe031e8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.033519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 168/347] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:03.034634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee8d7-44d9-4f66-bf20-c179efe031e8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.046255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.046891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.047168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.047444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.054820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:03.056265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:03.058032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 180/348] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:02 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:03.058992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.156541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee8d7-44d9-4f66-bf20-c179efe031e8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.171991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037d81-f74e-4b7b-a7f7-b396604456ac None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.197043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6949cab-47ac-4f73-a50e-d768a7f08ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.198053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949cab-47ac-4f73-a50e-d768a7f08ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.198538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949cab-47ac-4f73-a50e-d768a7f08ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.199029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949cab-47ac-4f73-a50e-d768a7f08ef2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.211795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6949cab-47ac-4f73-a50e-d768a7f08ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:03.212747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.213538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.214054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.214479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f6949cab-47ac-4f73-a50e-d768a7f08ef2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:03.218317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:03.219269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:03.220232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:03.223030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 169/349] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:03.224625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61d26-420c-42f9-83a0-2d58dd9f3354 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.225172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61d26-420c-42f9-83a0-2d58dd9f3354 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.225677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61d26-420c-42f9-83a0-2d58dd9f3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.235958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.252376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8cc61d26-420c-42f9-83a0-2d58dd9f3354 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:03.254057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8cc61d26-420c-42f9-83a0-2d58dd9f3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:03.304357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:03.305832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:03.328631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.350311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 170/350] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:03.351246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc61d26-420c-42f9-83a0-2d58dd9f3354 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.429366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 181/351] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:03.431387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.486567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc61d26-420c-42f9-83a0-2d58dd9f3354 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.494064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.533527 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cba824-f7dc-4b60-9bf0-7a5241e95b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.536601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cba824-f7dc-4b60-9bf0-7a5241e95b56 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.536601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cba824-f7dc-4b60-9bf0-7a5241e95b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.536601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cba824-f7dc-4b60-9bf0-7a5241e95b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.536601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cba824-f7dc-4b60-9bf0-7a5241e95b56 None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:03.536601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cba824-f7dc-4b60-9bf0-7a5241e95b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:03.537191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cba824-f7dc-4b60-9bf0-7a5241e95b56 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:03.543150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 171/352] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:03 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:03.545298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9877e2-5192-4813-be05-ad869c4fca03 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.546062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9877e2-5192-4813-be05-ad869c4fca03 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.546526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9877e2-5192-4813-be05-ad869c4fca03 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.549990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 172/353] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:03.551867 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a0780-5bfd-4a96-95df-d062a1eee972 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.552785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a0780-5bfd-4a96-95df-d062a1eee972 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.553326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a0780-5bfd-4a96-95df-d062a1eee972 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.556071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 173/354] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:03.557430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a0780-5bfd-4a96-95df-d062a1eee972 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.559039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfe4bd-0be4-4cf7-b50c-a4c8892ea709 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.607871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9e3aa-d933-4df1-b040-b4503d9ff7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.608880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9e3aa-d933-4df1-b040-b4503d9ff7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.609430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9e3aa-d933-4df1-b040-b4503d9ff7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.609888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9e3aa-d933-4df1-b040-b4503d9ff7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.611424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9e3aa-d933-4df1-b040-b4503d9ff7d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:03.611931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9e3aa-d933-4df1-b040-b4503d9ff7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:03.613458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9e3aa-d933-4df1-b040-b4503d9ff7d9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:03.635165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 182/355] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:10:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:03.637611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daa8aa-5810-4811-bb44-32f8cf1374ad None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.638050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daa8aa-5810-4811-bb44-32f8cf1374ad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.638473 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daa8aa-5810-4811-bb44-32f8cf1374ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.647270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.668482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-09daa8aa-5810-4811-bb44-32f8cf1374ad None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:03.669982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-09daa8aa-5810-4811-bb44-32f8cf1374ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:03.710205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a0780-5bfd-4a96-95df-d062a1eee972 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.755352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.756273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.756567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.756848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.757981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:03.759408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:03.760200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 183/356] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:03.764364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 174/357] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:03 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:03.764500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418bfbf-1d10-42a7-a510-f9904187a874 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.764500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418bfbf-1d10-42a7-a510-f9904187a874 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.764643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.764713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418bfbf-1d10-42a7-a510-f9904187a874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:03.784526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c418bfbf-1d10-42a7-a510-f9904187a874 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:03.786051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c418bfbf-1d10-42a7-a510-f9904187a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:03.826691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.877476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 184/358] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:03.878737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418bfbf-1d10-42a7-a510-f9904187a874 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:03.913256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789964-dda7-4176-a91e-1d1c8467796d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:03.954171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:03.979210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:03.979924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:03.980160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:03.980465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.066930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.068474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.078525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418bfbf-1d10-42a7-a510-f9904187a874 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.136822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.137465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.137744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.138019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.148707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:04.153466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:04.154601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:04.155582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:04.158421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 185/359] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:04.159542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.193921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 175/360] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:04.195031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.206923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.224182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.295223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b8601-d428-496e-b90d-8398130d4b97 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.318439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf831-4657-4b50-aae2-189dde2deccc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.347467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.348505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.349018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.349491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.350912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.352708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.354610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 186/361] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:04.355758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.369559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.370224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.370517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.370801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.383314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:04.388496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:04.389368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:04.390154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 176/362] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:04.390813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.483394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.488757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343e17-9d51-4836-9c20-5c9158381bb4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.489515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.513798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940a0fe-3a52-411c-8910-2c327f1b903c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.530995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.532624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.533477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.533954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.534829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:04.535348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.536805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.545852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 187/363] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:04.546476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.558990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.559639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.559921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.560199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.561368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.562810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.564694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 177/364] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:04.565681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.677543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661157c0-50e1-4b12-bae6-92c1b74d2c41 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.703257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae95032-2dc2-4f37-9308-5509b395ba86 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.723103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.724041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.724369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.725969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.740108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:04.745696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:04.746584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:04.747372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:04.749647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 188/365] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:04.750606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.757017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.757683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.757966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.758247 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.758988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:04.759304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.760967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.769882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 178/366] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=e06796d7090a468581574c96a6f9f18e => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:04.771085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:04.786570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.792031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:04.884705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02df29-a802-4e6f-ba97-76764ad819c5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.897513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41259-73d7-44a3-84fd-ed3c23807932 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:04.927364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.928393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.928828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.929250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.930255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:04.930828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:04.932413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:04.939955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:04.940506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:04.940790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:04.941374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:04.944330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 189/367] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:04.945452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.024062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.025605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.042215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.052600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.061776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c934f-fcc9-4fb8-a548-4162b86bf1b8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.107627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.108814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.109250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.109704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.111785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.113747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.118108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 190/368] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:05.119159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.165783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 179/369] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:05.166634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.251426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26530379-e140-48c6-b7d7-671df76f2ae6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.298342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.299691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.300250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.300714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.301533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:05.301989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.304779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.309582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c141d8d-ba69-459a-854d-8484d6b59bcc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.319729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 191/370] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:05.320903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.326866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.345405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.359931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.361732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.362168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.363402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] PATH_INFO: `/v3/users/a487a92974fc4b76aa6feebb321ae22b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.366173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] RBAC: Authorizing `identity:get_user(user_id=a487a92974fc4b76aa6feebb321ae22b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.368845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.371491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 180/371] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/users/a487a92974fc4b76aa6feebb321ae22b => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:05.372391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.452201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52335-e74b-4b1b-9bfe-79fb8488b0eb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.490227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.491182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.491668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.492156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.492559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69844a3f-0bb2-4990-95b8-c1b6a84bc3ca None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.493534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:05.494144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.495788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.502220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 192/372] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:05.503378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.562707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.563935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.564236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.564570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.565643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.567099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.568998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 181/373] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:05.569665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.604665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.619768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6d68-9aa7-4b06-bc22-9661b3a8e589 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.638568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.659212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e018d5-b1b5-4313-9d22-5774b62a18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.660269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e018d5-b1b5-4313-9d22-5774b62a18c5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.660757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e018d5-b1b5-4313-9d22-5774b62a18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.661245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e018d5-b1b5-4313-9d22-5774b62a18c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.698187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc81ef-4c1c-4299-bd84-a781dbb4a58b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:05.738149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:05.738796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.739075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.739349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.740089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] RBAC: Adding query filter params (role.id=8530394e88764d83bf17527b2c8c18e2, user.id=a487a92974fc4b76aa6feebb321ae22b, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:05.740456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.741864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.745135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e018d5-b1b5-4313-9d22-5774b62a18c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:05.746905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e018d5-b1b5-4313-9d22-5774b62a18c5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:05.761785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 182/374] 10.222.0.86 () {56 vars in 1308 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/role_assignments?user.id=a487a92974fc4b76aa6feebb321ae22b&scope.system=all&role.id=8530394e88764d83bf17527b2c8c18e2 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:05.762720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:05.849843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:05.884667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 193/375] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:05.886273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ece7c-1a41-4099-9194-2862270db610 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:05.887151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ece7c-1a41-4099-9194-2862270db610 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:05.887574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ece7c-1a41-4099-9194-2862270db610 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:05.889150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 194/376] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:05.895122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ece7c-1a41-4099-9194-2862270db610 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.003230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6c2c4-2b37-44b7-9988-8942200f8513 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.010884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:06.037885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ece7c-1a41-4099-9194-2862270db610 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.040335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cb2ae-1c73-436e-b24a-5037614735dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.040985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb2ae-1c73-436e-b24a-5037614735dc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.041271 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb2ae-1c73-436e-b24a-5037614735dc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.041552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb2ae-1c73-436e-b24a-5037614735dc None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.042693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb2ae-1c73-436e-b24a-5037614735dc None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.044242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb2ae-1c73-436e-b24a-5037614735dc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.046157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 183/377] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:06.049029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21188-22b5-4b6f-b372-905fd5b80bf7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.049349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21188-22b5-4b6f-b372-905fd5b80bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.050541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21188-22b5-4b6f-b372-905fd5b80bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.070530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-39a21188-22b5-4b6f-b372-905fd5b80bf7 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:06.071737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-39a21188-22b5-4b6f-b372-905fd5b80bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:06.086914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.087571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.087858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.088136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] PATH_INFO: `/v3/projects/83901483583f4a448b5d5f90ea5d58ed` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.092941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] RBAC: Authorizing `identity:get_project(project_id=83901483583f4a448b5d5f90ea5d58ed)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.094468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.096413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 195/378] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:05 2022] GET /identity/v3/projects/83901483583f4a448b5d5f90ea5d58ed => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:06.097420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.156513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 184/379] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:06.157640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21188-22b5-4b6f-b372-905fd5b80bf7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.175063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:06.295728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21188-22b5-4b6f-b372-905fd5b80bf7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.298822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:06.307071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189725-7e75-4230-9871-c045c30f72eb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.333093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f5121-476d-4424-933f-4e9339003647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.333745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f5121-476d-4424-933f-4e9339003647 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.334029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f5121-476d-4424-933f-4e9339003647 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.334311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f5121-476d-4424-933f-4e9339003647 None admin] PATH_INFO: `/v3/groups/3cd55c1a400c43a38f304a2fa889790c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.340377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f5121-476d-4424-933f-4e9339003647 None admin] RBAC: Authorizing `identity:get_group(group_id=3cd55c1a400c43a38f304a2fa889790c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.341890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f5121-476d-4424-933f-4e9339003647 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.345375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 185/380] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/groups/3cd55c1a400c43a38f304a2fa889790c => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:06.350196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f5121-476d-4424-933f-4e9339003647 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.416949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.417583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.417875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.418154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.418901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:06.419215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.420718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.438692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 196/381] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=e06796d7090a468581574c96a6f9f18e => generated 260 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:06.462074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f5121-476d-4424-933f-4e9339003647 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.498524 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.499158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.499446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.499727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.500503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] RBAC: Adding query filter params (group.id=3cd55c1a400c43a38f304a2fa889790c, role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=83901483583f4a448b5d5f90ea5d58ed) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:06.501833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.503007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.509395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.516993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 186/382] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/role_assignments?group.id=3cd55c1a400c43a38f304a2fa889790c&scope.project.id=83901483583f4a448b5d5f90ea5d58ed&role.id=e15e6a68b97848f894a24857503ceab4 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:06.693852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5892-ea1c-431e-bff6-4085479d8b4d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.704454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:06.730891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.731528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.731813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.732096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.743882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:06.748835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:06.749915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:06.751526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:06.757784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 197/383] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:06.763369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:06.816416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:06.912400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29550a39-a6e9-4856-835b-39efbe71f41c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:06.955249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:06.956257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:06.956542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:06.956816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:06.957498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:06.957799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:06.959252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:06.969327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 187/384] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:06.974917 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:07.105556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc84b3-f468-45ad-88de-9ef7f3f7a278 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:07.146584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:07.147220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:07.147504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:07.147778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:07.148908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:07.150347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:07.152204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 198/385] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:06 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:07.158467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:07.272382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:07.279589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672eec7-30a7-47cf-ac48-24fc7471e5c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:07.315757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a203-d5bb-4ae1-9f6f-5f90b3276470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:07.316435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a203-d5bb-4ae1-9f6f-5f90b3276470 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:07.316719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a203-d5bb-4ae1-9f6f-5f90b3276470 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:07.316999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a203-d5bb-4ae1-9f6f-5f90b3276470 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:07.318168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a203-d5bb-4ae1-9f6f-5f90b3276470 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:07.319628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a203-d5bb-4ae1-9f6f-5f90b3276470 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:07.321326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 188/386] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:07 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:07.327971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:07.366860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:07.442415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f61d9-04aa-4a86-960c-a1b8496ac9fe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:07.485242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9a496-4684-4638-b988-1e5146495320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:07.485839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a496-4684-4638-b988-1e5146495320 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:07.486125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a496-4684-4638-b988-1e5146495320 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:07.486403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a496-4684-4638-b988-1e5146495320 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/groups/961eed6bd69c42448429ab353d19bf5b/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:07.493454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9a496-4684-4638-b988-1e5146495320 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0df468a474a2a93ed2ac7f8eabc80, group_id=961eed6bd69c42448429ab353d19bf5b, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:07.494901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9a496-4684-4638-b988-1e5146495320 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:07.588534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 199/387] 10.222.0.86 () {58 vars in 1442 bytes} [Thu Aug 18 11:10:07 2022] PUT /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/groups/961eed6bd69c42448429ab353d19bf5b/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:07.704553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f7d47-5c05-4914-8ba0-072362358bad None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:07.704877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f7d47-5c05-4914-8ba0-072362358bad None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:07.705119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f7d47-5c05-4914-8ba0-072362358bad None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:07.706963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 189/388] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:07.716579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcfb9b-efac-4bd9-8f7d-7861ed975054 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:07.716936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcfb9b-efac-4bd9-8f7d-7861ed975054 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:07.717158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcfb9b-efac-4bd9-8f7d-7861ed975054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:07.745584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-42fcfb9b-efac-4bd9-8f7d-7861ed975054 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:07.746739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-42fcfb9b-efac-4bd9-8f7d-7861ed975054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:07.832767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 200/389] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:08.082778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94e1d-affe-4c8a-8c46-fff6c9fc46e1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:08.083154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94e1d-affe-4c8a-8c46-fff6c9fc46e1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:08.083344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe94e1d-affe-4c8a-8c46-fff6c9fc46e1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:08.084987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 190/390] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:08.093012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8275d-b703-4766-86d6-efff93344c26 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:08.093895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8275d-b703-4766-86d6-efff93344c26 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:08.094452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8275d-b703-4766-86d6-efff93344c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:08.119886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d9d8275d-b703-4766-86d6-efff93344c26 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:08.121438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d9d8275d-b703-4766-86d6-efff93344c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:08.153729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:08.218855 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 201/391] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:08.236235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94e1d-affe-4c8a-8c46-fff6c9fc46e1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:08.401890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe94e1d-affe-4c8a-8c46-fff6c9fc46e1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:08.440460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:08.441110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:08.441391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:08.441724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:08.452979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:08.461150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:08.462211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:08.462994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 191/392] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:08.468468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8275d-b703-4766-86d6-efff93344c26 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:08.699306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8275d-b703-4766-86d6-efff93344c26 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:08.713420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:08.785931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:08.794584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:08.795401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:08.798254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:08.798691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:08.799551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:08.802524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:08.804077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:08.852538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 202/393] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:08.868170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:08.960680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:08.970759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0de38-fe5a-4bbb-8561-b921fe8f7fa8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.026414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48200c6-7810-4368-8e8e-809155b9d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.027217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48200c6-7810-4368-8e8e-809155b9d172 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.027507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48200c6-7810-4368-8e8e-809155b9d172 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.028586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48200c6-7810-4368-8e8e-809155b9d172 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.042037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48200c6-7810-4368-8e8e-809155b9d172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d48200c6-7810-4368-8e8e-809155b9d172 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:09.048599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:09.049561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:09.050355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:09.051688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 192/394] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:09.053482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235707b-55b3-4893-a483-ba674dfd95dd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.053778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235707b-55b3-4893-a483-ba674dfd95dd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.054059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235707b-55b3-4893-a483-ba674dfd95dd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.055404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 193/395] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:09.056472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ddcd-737b-4558-887e-b6786f147fe5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.056811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ddcd-737b-4558-887e-b6786f147fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.057127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ddcd-737b-4558-887e-b6786f147fe5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.058503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 194/396] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:09.060947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ddcd-737b-4558-887e-b6786f147fe5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.068916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b7ec7-f11d-4894-bc67-a62abba421be None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.107927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6c814-594f-457f-91ec-242d61e90e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.108623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6c814-594f-457f-91ec-242d61e90e8b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.108882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6c814-594f-457f-91ec-242d61e90e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.109439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6c814-594f-457f-91ec-242d61e90e8b None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.110521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6c814-594f-457f-91ec-242d61e90e8b None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:09.111971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6c814-594f-457f-91ec-242d61e90e8b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:09.117888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 203/397] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:08 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:09.117888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685df1f5-4054-485f-a460-b399d6f7b78b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.117888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685df1f5-4054-485f-a460-b399d6f7b78b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.117888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685df1f5-4054-485f-a460-b399d6f7b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.133358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-685df1f5-4054-485f-a460-b399d6f7b78b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:09.134559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-685df1f5-4054-485f-a460-b399d6f7b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:09.159167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:09.178414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ddcd-737b-4558-887e-b6786f147fe5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.210139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 204/398] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:09.228117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c7698-f9dc-40d4-a8a6-06850b33691d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.228117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c7698-f9dc-40d4-a8a6-06850b33691d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.228117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c7698-f9dc-40d4-a8a6-06850b33691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.235343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ab1c7698-f9dc-40d4-a8a6-06850b33691d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:09.236824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ab1c7698-f9dc-40d4-a8a6-06850b33691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:09.238097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.239655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.240291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.240679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.241513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:09.241972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:09.243627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:09.250090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:09.254906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 195/399] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:10:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:09.255612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.320608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 205/400] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:09.321666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c7698-f9dc-40d4-a8a6-06850b33691d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.391192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d48d87-ac83-4951-8a01-9182abb4950e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.426102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c7698-f9dc-40d4-a8a6-06850b33691d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.457636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.458283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.458563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.458836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.460875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:09.464391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:09.466243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 196/401] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:09 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:09.471920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.483675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.484318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.484603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.484943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.486367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:09.487797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:09.489902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 206/402] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:09 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:09.498346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.503945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:09.564609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:09.620926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5756b-b016-468c-b035-68b18378a451 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.621150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d122-e94a-4097-a383-b1aaa05af6ab None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.657228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.657576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.658090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.658216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.658439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.658532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.658735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.658846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/groups/961eed6bd69c42448429ab353d19bf5b/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.659863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:09.661102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0df468a474a2a93ed2ac7f8eabc80, group_id=961eed6bd69c42448429ab353d19bf5b, role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:09.661329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:09.662680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:09.668000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 207/403] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:09 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:09.668000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.748477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:09.754138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 197/404] 10.222.0.86 () {58 vars in 1442 bytes} [Thu Aug 18 11:10:09 2022] PUT /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80/groups/961eed6bd69c42448429ab353d19bf5b/roles/e06796d7090a468581574c96a6f9f18e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:09.755412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.780440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f158eac-03f7-4c2c-9855-925e587f196d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.838502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.839155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.839881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.839881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.852773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:09.858073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:09.859108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 208/405] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:09.860743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.862794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:09.911635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450e93-d02e-4cac-b17f-343bee0f940b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:09.953046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:09.953955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:09.954418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:09.954691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:09.965368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:09.971061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:09.971959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:09.972777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 198/406] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:09.973426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:09.995437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8428e85-09bd-41da-a78a-a0f132f8928c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.043576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.044336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.044659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.044954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/groups/961eed6bd69c42448429ab353d19bf5b/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.047846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] RBAC: Authorizing `identity:create_grant(project_id=45a590fc1d3148ad8f13ce4ed581eade, group_id=961eed6bd69c42448429ab353d19bf5b, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.049647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.084038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785a843-888e-4d49-b181-0389f215a948 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.116949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:10.122068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.122736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.123021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.123293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.123967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:10.124297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.126559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.139615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 199/407] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:10.139615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.150657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 209/408] 10.222.0.86 () {58 vars in 1442 bytes} [Thu Aug 18 11:10:09 2022] PUT /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/groups/961eed6bd69c42448429ab353d19bf5b/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:10.155452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.164396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:10.284197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254375d-4a58-4bcd-ac94-5d52dbf1e95d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.296067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d38e2-4712-4dfc-b3e4-25ee93589dda None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.327368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484d89a-f639-49c4-94c9-88e4f3d5bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.328300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d89a-f639-49c4-94c9-88e4f3d5bd17 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.329300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d89a-f639-49c4-94c9-88e4f3d5bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.329740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d89a-f639-49c4-94c9-88e4f3d5bd17 None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.331772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484d89a-f639-49c4-94c9-88e4f3d5bd17 None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.333565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484d89a-f639-49c4-94c9-88e4f3d5bd17 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.335409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 210/409] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:10 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:10.336753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882aaf8-70ab-423d-9060-de3bdd26a6c6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.337039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882aaf8-70ab-423d-9060-de3bdd26a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.337326 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882aaf8-70ab-423d-9060-de3bdd26a6c6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.338780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 211/410] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:10.342570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882aaf8-70ab-423d-9060-de3bdd26a6c6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.342879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f3349-ef29-4e1a-a704-ae2b155f2623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.343692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f3349-ef29-4e1a-a704-ae2b155f2623 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.343985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f3349-ef29-4e1a-a704-ae2b155f2623 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.344833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f3349-ef29-4e1a-a704-ae2b155f2623 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.345717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f3349-ef29-4e1a-a704-ae2b155f2623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:10.346030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f3349-ef29-4e1a-a704-ae2b155f2623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.347430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f3349-ef29-4e1a-a704-ae2b155f2623 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.359629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 200/411] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:10.361609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f449-98d4-450c-9752-7b5df631be54 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.361980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f449-98d4-450c-9752-7b5df631be54 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.362318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f449-98d4-450c-9752-7b5df631be54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.381680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0e30f449-98d4-450c-9752-7b5df631be54 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:10.382889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e30f449-98d4-450c-9752-7b5df631be54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:10.426948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:10.449947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:10.465274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882aaf8-70ab-423d-9060-de3bdd26a6c6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.468302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 201/412] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:10.470003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30f449-98d4-450c-9752-7b5df631be54 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.509478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.510141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.510843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.511128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.512285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.514095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.516936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 212/413] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:10 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:10.522773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.579652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30f449-98d4-450c-9752-7b5df631be54 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.615917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.617455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.618189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.618700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] PATH_INFO: `/v3/groups/3cd55c1a400c43a38f304a2fa889790c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.620632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] RBAC: Authorizing `identity:get_group(group_id=3cd55c1a400c43a38f304a2fa889790c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.622713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.625159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 202/414] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:10 2022] GET /identity/v3/groups/3cd55c1a400c43a38f304a2fa889790c => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:10.632272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c71c-e94d-4ec2-8483-926571c5fce0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.633305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.692588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.693289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.693574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.693852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/groups/961eed6bd69c42448429ab353d19bf5b/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.698643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] RBAC: Authorizing `identity:create_grant(project_id=45a590fc1d3148ad8f13ce4ed581eade, group_id=961eed6bd69c42448429ab353d19bf5b, role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.700093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.724867 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:10.771549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720318ad-dbb9-464a-93b4-2e3fa6fa0e61 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:10.782778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 213/415] 10.222.0.86 () {58 vars in 1442 bytes} [Thu Aug 18 11:10:10 2022] PUT /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade/groups/961eed6bd69c42448429ab353d19bf5b/roles/e06796d7090a468581574c96a6f9f18e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:10.783307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:10.817242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.841425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:10.841997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:10.842380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:10.842656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] PATH_INFO: `/v3/projects/83901483583f4a448b5d5f90ea5d58ed` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:10.847672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] RBAC: Authorizing `identity:get_project(project_id=83901483583f4a448b5d5f90ea5d58ed)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:10.849364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:10.852786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 203/416] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:10 2022] GET /identity/v3/projects/83901483583f4a448b5d5f90ea5d58ed => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:10.857150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:10.989930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5aa67-82a3-4a0c-85c0-21e0040a8331 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.005223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c918bc9-2571-4cfa-8efc-4ff3cc891715 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.037953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.038207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.038672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.038958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.039237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.052935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:11.054074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.054674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.054959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.055236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] PATH_INFO: `/v3/projects/83901483583f4a448b5d5f90ea5d58ed/groups/3cd55c1a400c43a38f304a2fa889790c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.057194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] RBAC: Authorizing `identity:create_grant(project_id=83901483583f4a448b5d5f90ea5d58ed, group_id=3cd55c1a400c43a38f304a2fa889790c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:11.058553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:11.059390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:11.060288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:11.060904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.060971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 214/417] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:11.066232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.127101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 204/418] 10.222.0.86 () {58 vars in 1442 bytes} [Thu Aug 18 11:10:10 2022] PUT /identity/v3/projects/83901483583f4a448b5d5f90ea5d58ed/groups/3cd55c1a400c43a38f304a2fa889790c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:11.155531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.212737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117a28b-c257-466d-86cd-bf03f2e1186e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.265606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.266322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.266606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.266883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.267559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:11.267859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.269274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.284125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 215/419] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:10:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:11.289830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.410150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6787190-675a-4efb-8520-aa1f6db0d27a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.457502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.458499 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.458982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.459449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.527467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.552055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.553561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.681659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 205/420] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:11.687478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.805026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc63d42-c32c-4c32-ad41-38fce84a100b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:11.826135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.847826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:11.848503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:11.848790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:11.849067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:11.850190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:11.851860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:11.853801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 216/421] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:11 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:11.860936 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:11.975260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:11.999069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3098d-9e29-485d-8733-83f270226577 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.035883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382effc5-d714-480c-b07b-8c5941f6ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.036553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382effc5-d714-480c-b07b-8c5941f6ebac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.036834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382effc5-d714-480c-b07b-8c5941f6ebac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.037105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382effc5-d714-480c-b07b-8c5941f6ebac None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.038233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382effc5-d714-480c-b07b-8c5941f6ebac None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.039941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382effc5-d714-480c-b07b-8c5941f6ebac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.041909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 206/422] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:11 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:12.048277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.105821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec7d0a-4428-4609-8b95-93fa976dbd18 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.106142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec7d0a-4428-4609-8b95-93fa976dbd18 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.106370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec7d0a-4428-4609-8b95-93fa976dbd18 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.107812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 207/423] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:10:12.113584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff75fa-880c-4d78-9587-18097005f6cb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.114219 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff75fa-880c-4d78-9587-18097005f6cb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.114728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff75fa-880c-4d78-9587-18097005f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.157478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-84ff75fa-880c-4d78-9587-18097005f6cb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:12.159321 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-84ff75fa-880c-4d78-9587-18097005f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:12.175612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4dfe-8351-4b04-9b1b-5bfc20315cfc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.249061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fc844-16bc-4679-9e2a-ae2dc3bd7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.249673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc844-16bc-4679-9e2a-ae2dc3bd7369 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.249965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc844-16bc-4679-9e2a-ae2dc3bd7369 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.251178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc844-16bc-4679-9e2a-ae2dc3bd7369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.252197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc844-16bc-4679-9e2a-ae2dc3bd7369 None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:12.252559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc844-16bc-4679-9e2a-ae2dc3bd7369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:12.254209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc844-16bc-4679-9e2a-ae2dc3bd7369 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:12.268766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 217/424] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:12 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:12.283848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 208/425] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:10:12.610261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbffe3-deac-45a2-ad3e-7fdb8d98e818 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.610724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbffe3-deac-45a2-ad3e-7fdb8d98e818 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.611239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbffe3-deac-45a2-ad3e-7fdb8d98e818 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.612831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 218/426] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:12.618254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf598-09e0-4066-b479-61a4d9e9ccd9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.618695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf598-09e0-4066-b479-61a4d9e9ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.618785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf598-09e0-4066-b479-61a4d9e9ccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.643563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c73bf598-09e0-4066-b479-61a4d9e9ccd9 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:12.644800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c73bf598-09e0-4066-b479-61a4d9e9ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:12.677298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbffe3-deac-45a2-ad3e-7fdb8d98e818 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.731643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 209/427] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:12.744611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:12.788852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbffe3-deac-45a2-ad3e-7fdb8d98e818 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:12.826041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:12.826673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:12.826952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:12.827223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:12.838270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:12.843320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:12.844989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:12.846741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 219/428] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:12.850991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bf598-09e0-4066-b479-61a4d9e9ccd9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:12.864519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:12.967158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bf598-09e0-4066-b479-61a4d9e9ccd9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.007895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.008545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.008827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.009104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.009780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:13.010085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:13.011528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:13.020938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 210/429] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:13.026365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.098078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.152642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5adadd-50a8-4cd8-ac1a-5115d6be7b90 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.167325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.187565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.194853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4144d4-9ed7-4ea1-a4aa-fae9864a4a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.195469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4144d4-9ed7-4ea1-a4aa-fae9864a4a16 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.195752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4144d4-9ed7-4ea1-a4aa-fae9864a4a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.196024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4144d4-9ed7-4ea1-a4aa-fae9864a4a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.257209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e7dd0-2ccf-4bf6-be4f-ef1d1a5c9d29 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.280285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4144d4-9ed7-4ea1-a4aa-fae9864a4a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:13.282314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4144d4-9ed7-4ea1-a4aa-fae9864a4a16 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:13.294715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f15f-1c11-44ce-a8bd-f453cce126a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.295676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f15f-1c11-44ce-a8bd-f453cce126a1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.295961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f15f-1c11-44ce-a8bd-f453cce126a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.296265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f15f-1c11-44ce-a8bd-f453cce126a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.306696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087f15f-1c11-44ce-a8bd-f453cce126a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d087f15f-1c11-44ce-a8bd-f453cce126a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:13.312039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:13.313075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 211/430] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:13.314325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695466e-bb1e-4c12-b0e9-ec98494818d0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.315200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695466e-bb1e-4c12-b0e9-ec98494818d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.315200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695466e-bb1e-4c12-b0e9-ec98494818d0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.316283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 212/431] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:13.321096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695466e-bb1e-4c12-b0e9-ec98494818d0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.404595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 220/432] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 11:10:13.405696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff60ef-14b6-4fb6-bd74-de1296f524e0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.405981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff60ef-14b6-4fb6-bd74-de1296f524e0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.406254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff60ef-14b6-4fb6-bd74-de1296f524e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.424715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-faff60ef-14b6-4fb6-bd74-de1296f524e0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:13.425875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-faff60ef-14b6-4fb6-bd74-de1296f524e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:13.434058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.438089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695466e-bb1e-4c12-b0e9-ec98494818d0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.471510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.477637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.478255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.478543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.481496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.481496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:13.481496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:13.481496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:13.489821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 213/433] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:13.490511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.502130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 221/434] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:13.509135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff60ef-14b6-4fb6-bd74-de1296f524e0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.597303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a02785-b2d7-46e7-b243-e6269793ade0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.630246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff60ef-14b6-4fb6-bd74-de1296f524e0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.633790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ae0a5-c64d-4c33-b593-0e37be55ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.634424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ae0a5-c64d-4c33-b593-0e37be55ffad None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.634705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ae0a5-c64d-4c33-b593-0e37be55ffad None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.634979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ae0a5-c64d-4c33-b593-0e37be55ffad None admin] PATH_INFO: `/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.636117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ae0a5-c64d-4c33-b593-0e37be55ffad None admin] RBAC: Authorizing `identity:get_project(project_id=b9b0df468a474a2a93ed2ac7f8eabc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:13.637605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ae0a5-c64d-4c33-b593-0e37be55ffad None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:13.639224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 214/435] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/projects/b9b0df468a474a2a93ed2ac7f8eabc80 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:13.640355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45817-5c77-4c5a-8a81-ecf8ec5b3e83 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.640639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45817-5c77-4c5a-8a81-ecf8ec5b3e83 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.641459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45817-5c77-4c5a-8a81-ecf8ec5b3e83 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.642804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 215/436] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:13.646343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f45817-5c77-4c5a-8a81-ecf8ec5b3e83 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.672770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.673487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.673766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.674238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.689155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.710379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.749103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:13.755277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f45817-5c77-4c5a-8a81-ecf8ec5b3e83 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.755401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:13.788407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab211e-843a-44b4-9c1b-b6801349ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.789037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab211e-843a-44b4-9c1b-b6801349ade4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.789314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab211e-843a-44b4-9c1b-b6801349ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.789836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab211e-843a-44b4-9c1b-b6801349ade4 None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.790931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab211e-843a-44b4-9c1b-b6801349ade4 None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:13.792391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab211e-843a-44b4-9c1b-b6801349ade4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:13.793989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 216/437] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:13.795071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d228f-d852-4314-91c8-b6e7e3586ff8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:13.795348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d228f-d852-4314-91c8-b6e7e3586ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:13.795640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d228f-d852-4314-91c8-b6e7e3586ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:13.815253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0a0d228f-d852-4314-91c8-b6e7e3586ff8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:13.816483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0a0d228f-d852-4314-91c8-b6e7e3586ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:13.856535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 222/438] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:13.857211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.886199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 217/439] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:13.887040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d228f-d852-4314-91c8-b6e7e3586ff8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:13.902938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.951786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:13.963272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86837fa-e1d2-46f0-95fb-1e76fc8ca450 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.993743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d228f-d852-4314-91c8-b6e7e3586ff8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:13.998875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:13.999659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.000099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.000807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.010797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:14.015595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:14.016858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:14.017627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:14.018212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 223/440] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:14.018703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.036093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.037030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.037613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.038073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.039302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:14.040059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.041721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.048838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 218/441] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:13 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=b9b0df468a474a2a93ed2ac7f8eabc80&role.id=e06796d7090a468581574c96a6f9f18e => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:14.049601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.144831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3809cfe-8daa-4dd9-be64-4ddab5f2768a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.146621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.170605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2a57-e9af-4cca-9ede-b8bcb84d8fb5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.184776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.185424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.185709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.185981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.187154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.188853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.192355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 224/442] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:14.192355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.201054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.222695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.223323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.223610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.223887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.224727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:14.225145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.226546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.238857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 219/443] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:14.238857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.312175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebea72-7b11-44dc-8aa9-b33f209cb958 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.355965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.356865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.357150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.357430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.362904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34de5-7922-4ef2-bcd6-7d73f86a5e8c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.372453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:14.377800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:14.378746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:14.379747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 225/444] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:14.380552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.408575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.409223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.409503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.409779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.411486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.413006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.414999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 220/445] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:14.415914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.420664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.478394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.492860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5478d9-4292-4f7a-9ec6-18f29b461c14 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.522223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87237d8-b7f0-49cb-8cb6-cf5f2b7dcc68 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.526198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.526798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.527077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.527351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.556181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.556823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.557108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.557384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.558051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:14.558355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.559716 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.568447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 221/446] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:14.569032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.598121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.599591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.629200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.665898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc65a9-ef25-4cae-8b53-5376537542dc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.681567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.698929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 226/447] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:14.699867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.705274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.705903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.706186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.706461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.707191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=7e46fd9311c848bb8730f41e91ba92ea, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:14.707500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.708964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.714869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 222/448] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=7e46fd9311c848bb8730f41e91ba92ea => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:14.715629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.820657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e454-f0e5-4eb2-ae3f-65d2c2c2c2a7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.829398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302ff1f-88e0-43bf-999f-3d9bc42d1464 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:14.857312 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.863945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.864623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.867667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.867667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.870840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:14.871487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:14.871774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:14.872104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] PATH_INFO: `/v3/projects/45a590fc1d3148ad8f13ce4ed581eade` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:14.873258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=45a590fc1d3148ad8f13ce4ed581eade)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.874709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:14.879280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 223/449] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/projects/45a590fc1d3148ad8f13ce4ed581eade => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:14.882821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:14.946182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:14.946389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:14.947714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:15.007361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc08afb-1c30-4905-9a20-aedf6845d2f7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:15.046701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:15.047925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:15.048222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:15.048505 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] PATH_INFO: `/v3/groups/961eed6bd69c42448429ab353d19bf5b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:15.049641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] RBAC: Authorizing `identity:get_group(group_id=961eed6bd69c42448429ab353d19bf5b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:15.051089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:15.052698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 224/450] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/groups/961eed6bd69c42448429ab353d19bf5b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:15.058591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:15.076283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 227/451] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:15.082133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:15.113116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:15.162708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8404b1e-5e0f-4df2-93ac-c2d2c1154a44 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:15.181151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:15.183973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6b513-c232-41b7-bf1f-3c9ab7482b21 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:15.198015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:15.198625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:15.198937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:15.199212 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:15.199948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] RBAC: Adding query filter params (group.id=961eed6bd69c42448429ab353d19bf5b, role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=45a590fc1d3148ad8f13ce4ed581eade) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:15.200290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:15.201784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:15.208826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 225/452] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:15 2022] GET /identity/v3/role_assignments?group.id=961eed6bd69c42448429ab353d19bf5b&scope.project.id=45a590fc1d3148ad8f13ce4ed581eade&role.id=e06796d7090a468581574c96a6f9f18e => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:15.218753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:15.219620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:15.219900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:15.220177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] PATH_INFO: `/v3/projects/83901483583f4a448b5d5f90ea5d58ed` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:15.221480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=83901483583f4a448b5d5f90ea5d58ed)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:15.223001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:15.229478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 228/453] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:10:15 2022] GET /identity/v3/projects/83901483583f4a448b5d5f90ea5d58ed => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:15.230523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:15.338490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b02473-ca6f-4a36-a8c4-3348383ab7a5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:15.373695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6acae-bca6-4438-b99b-34503e25d325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:15.374325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6acae-bca6-4438-b99b-34503e25d325 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:15.374603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6acae-bca6-4438-b99b-34503e25d325 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:15.374876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6acae-bca6-4438-b99b-34503e25d325 None admin] PATH_INFO: `/v3/groups/3cd55c1a400c43a38f304a2fa889790c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:15.376268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6acae-bca6-4438-b99b-34503e25d325 None admin] RBAC: Authorizing `identity:get_group(group_id=3cd55c1a400c43a38f304a2fa889790c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:15.377720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6acae-bca6-4438-b99b-34503e25d325 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:15.379632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 226/454] 10.222.0.86 () {56 vars in 1180 bytes} [Thu Aug 18 11:10:15 2022] GET /identity/v3/groups/3cd55c1a400c43a38f304a2fa889790c => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:15.385298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:15.484522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:15.488886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8343b-d414-4869-a5e3-639350aab3e3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:15.522554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd818-5064-41cf-9de0-c71d78eb0a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:15.523187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd818-5064-41cf-9de0-c71d78eb0a54 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:15.523556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd818-5064-41cf-9de0-c71d78eb0a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:15.523833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd818-5064-41cf-9de0-c71d78eb0a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:15.524593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd818-5064-41cf-9de0-c71d78eb0a54 None admin] RBAC: Adding query filter params (group.id=3cd55c1a400c43a38f304a2fa889790c, role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=83901483583f4a448b5d5f90ea5d58ed) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:15.524909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd818-5064-41cf-9de0-c71d78eb0a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:15.526337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd818-5064-41cf-9de0-c71d78eb0a54 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:15.532953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 229/455] 10.222.0.86 () {56 vars in 1376 bytes} [Thu Aug 18 11:10:15 2022] GET /identity/v3/role_assignments?group.id=3cd55c1a400c43a38f304a2fa889790c&scope.project.id=83901483583f4a448b5d5f90ea5d58ed&role.id=e15e6a68b97848f894a24857503ceab4 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:17.860055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09413f63-a5df-42ac-944f-756f62bc53e7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.860671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09413f63-a5df-42ac-944f-756f62bc53e7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.860749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09413f63-a5df-42ac-944f-756f62bc53e7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.862085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 227/456] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:17.867529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9435-95d7-44ee-a92d-f760ceebdc20 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:17.868676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9435-95d7-44ee-a92d-f760ceebdc20 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:17.869177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9435-95d7-44ee-a92d-f760ceebdc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:17.895553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c19b9435-95d7-44ee-a92d-f760ceebdc20 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:17.897361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c19b9435-95d7-44ee-a92d-f760ceebdc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:17.991785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 230/457] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:18.069021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e383fb-64c6-43c4-a7cc-ce30dd3ff81e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.069698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e383fb-64c6-43c4-a7cc-ce30dd3ff81e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.070188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e383fb-64c6-43c4-a7cc-ce30dd3ff81e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.071737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 228/458] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:18.077289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1f584-86cc-4cba-b356-c07d1c070372 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.077817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1f584-86cc-4cba-b356-c07d1c070372 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.078671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1f584-86cc-4cba-b356-c07d1c070372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.109910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-90d1f584-86cc-4cba-b356-c07d1c070372 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:18.111487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-90d1f584-86cc-4cba-b356-c07d1c070372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:18.202868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 231/459] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:18.326417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e383fb-64c6-43c4-a7cc-ce30dd3ff81e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:18.394252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:18.470121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e383fb-64c6-43c4-a7cc-ce30dd3ff81e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:18.514758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068ca2c-7867-4ef8-a0b9-2d2758adadb9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.515062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068ca2c-7867-4ef8-a0b9-2d2758adadb9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.515334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068ca2c-7867-4ef8-a0b9-2d2758adadb9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.517504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 232/460] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:18.518101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a2671-ba51-4527-b09b-78010bf888d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:18.518808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a2671-ba51-4527-b09b-78010bf888d2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.519093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a2671-ba51-4527-b09b-78010bf888d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.519366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a2671-ba51-4527-b09b-78010bf888d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.522628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889e8a-cf01-4fd5-9b8d-a9acd910ca59 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.522744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889e8a-cf01-4fd5-9b8d-a9acd910ca59 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.523032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889e8a-cf01-4fd5-9b8d-a9acd910ca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.540915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a2671-ba51-4527-b09b-78010bf888d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:18.542490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a2671-ba51-4527-b09b-78010bf888d2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:18.548025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b7889e8a-cf01-4fd5-9b8d-a9acd910ca59 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:18.549632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b7889e8a-cf01-4fd5-9b8d-a9acd910ca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-988a2671-ba51-4527-b09b-78010bf888d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:18.557638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:18.558533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:18.559358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:18.559358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:18.559358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:18.561229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 229/461] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:18.563146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851913d-fa55-4c7c-839f-314b9c2d1735 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.563953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851913d-fa55-4c7c-839f-314b9c2d1735 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.564413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851913d-fa55-4c7c-839f-314b9c2d1735 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.569917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 230/462] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:18.570821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851913d-fa55-4c7c-839f-314b9c2d1735 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:18.571799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:18.644245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 233/463] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:10:18.644245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4dffb-7b87-41f5-ad71-7bcec9aa8f44 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.644245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4dffb-7b87-41f5-ad71-7bcec9aa8f44 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.644245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4dffb-7b87-41f5-ad71-7bcec9aa8f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.666219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d1e4dffb-7b87-41f5-ad71-7bcec9aa8f44 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:18.667358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d1e4dffb-7b87-41f5-ad71-7bcec9aa8f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:18.698135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:18.703944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851913d-fa55-4c7c-839f-314b9c2d1735 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:18.746959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 234/464] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:18.747809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4dffb-7b87-41f5-ad71-7bcec9aa8f44 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:18.762403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:18.763029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.763307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.763582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.764248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:18.764557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:18.767662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:18.795606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 231/465] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:18.799031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:18.904766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:18.924140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4dffb-7b87-41f5-ad71-7bcec9aa8f44 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:18.966295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:18.967513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:18.968433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:18.970141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:18.972106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295c469-3d7c-4c94-a9a5-30936461e3f3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:18.983978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:18.986713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:19.008138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:19.009190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:19.010020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:19.010020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:19.010020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:19.010188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.010188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.010326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.010859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.011256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.012782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 235/466] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:19.012884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.014002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.118743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa5c44-9fee-43e6-a6f5-fd671d14df04 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.140253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 232/467] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:10:18 2022] POST /identity/v3/users => generated 246 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:19.140253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.167654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.173758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.174505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.174785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.175001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.177796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.190124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.192565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:19.216277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:19.217242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:19.218080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:19.218080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:19.218080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:19.220437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 236/468] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:19.221615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.283824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1cd22-f50f-4593-9d2d-4b5942080e88 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.327812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.329595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.329595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.329595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.329979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:19.330366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.331669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.346275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 233/469] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:19.347121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.374063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e59d10-1f85-466f-9b55-7dc4e773a63a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.412125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96709-5207-4fe3-a5e0-782b85425881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.412937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96709-5207-4fe3-a5e0-782b85425881 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.413323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96709-5207-4fe3-a5e0-782b85425881 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.413713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96709-5207-4fe3-a5e0-782b85425881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.425934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96709-5207-4fe3-a5e0-782b85425881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.427414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96709-5207-4fe3-a5e0-782b85425881 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.433185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-06b96709-5207-4fe3-a5e0-782b85425881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:19.442693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:19.444903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:19.445924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:19.445924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:19.445924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:19.445924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 237/470] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:19.446595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa7e9f-4f57-4339-b9bf-8fdd2afe1adf None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.446943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa7e9f-4f57-4339-b9bf-8fdd2afe1adf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.447297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa7e9f-4f57-4339-b9bf-8fdd2afe1adf None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.452276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 238/471] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:19.452276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa7e9f-4f57-4339-b9bf-8fdd2afe1adf None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.465267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e2e1-32eb-460e-a048-2e0027bfe8d7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.491804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.503256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.503882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.505555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.505555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.505555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:19.505555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.506939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.524410 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 234/472] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:19.524410 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.559253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa7e9f-4f57-4339-b9bf-8fdd2afe1adf None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.595423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794f8fe-06bb-41e9-993a-73aac9971fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.596047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f8fe-06bb-41e9-993a-73aac9971fad None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.596366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f8fe-06bb-41e9-993a-73aac9971fad None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.596646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794f8fe-06bb-41e9-993a-73aac9971fad None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.597298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794f8fe-06bb-41e9-993a-73aac9971fad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.598732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794f8fe-06bb-41e9-993a-73aac9971fad None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.629188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f03ce-a6d6-45d7-8944-2c2c035225c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.663320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.664088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.664749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.665086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.665684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:19.666019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.667358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.676569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 239/473] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:19.676569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec39d-66c9-4ba2-8c64-34673ea65a56 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.676569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec39d-66c9-4ba2-8c64-34673ea65a56 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.676569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fec39d-66c9-4ba2-8c64-34673ea65a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.677982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.695118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 235/474] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:19.696425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-68fec39d-66c9-4ba2-8c64-34673ea65a56 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:19.696661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.698003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-68fec39d-66c9-4ba2-8c64-34673ea65a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:19.797811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 240/475] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:19.798798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fec39d-66c9-4ba2-8c64-34673ea65a56 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:19.816668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ab81-974a-4468-abf0-9609c31914d6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:19.851616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:19.889205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2216d02-e647-460d-a484-e4692689359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:19.890093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216d02-e647-460d-a484-e4692689359e None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:19.891130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216d02-e647-460d-a484-e4692689359e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:19.891606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2216d02-e647-460d-a484-e4692689359e None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:19.892452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2216d02-e647-460d-a484-e4692689359e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:19.894069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2216d02-e647-460d-a484-e4692689359e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:19.961243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fec39d-66c9-4ba2-8c64-34673ea65a56 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.004609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.005393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.005686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.006016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.006729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:20.008918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:20.013266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 236/476] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/users => generated 249 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:20.095378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2216d02-e647-460d-a484-e4692689359e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.133422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 241/477] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:10:19 2022] POST /identity/v3/users => generated 248 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:20.174813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:20.237993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2216d02-e647-460d-a484-e4692689359e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.282631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.283697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.284240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.284714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.285608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:20.287270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:20.317278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.sql.core [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 11:10:20.317278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 11:10:20.317278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [parameters: {'id': '2e022f33250a4edaaa8cddc5b86946ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 11:10:20.317278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 18 11:10:20.335654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 11:10:20.336623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application yield resource Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise self.value Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application session.commit() Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 11:10:20.337541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.flush() Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application compat.raise_( Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 11:10:20.338418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:10:20.339916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:10:20.341695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [parameters: {'id': '2e022f33250a4edaaa8cddc5b86946ec', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:20.344427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 11:10:20.346357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:20.348439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 237/478] 10.222.0.86 () {60 vars in 1131 bytes} [Thu Aug 18 11:10:20 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:20.348584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.442806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:20.462965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5066d-3059-4c5c-8ae3-c82a26134a97 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.504613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3f078-80f4-4ae3-ba29-99302c0cc23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.505365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f078-80f4-4ae3-ba29-99302c0cc23d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.505749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f078-80f4-4ae3-ba29-99302c0cc23d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.506122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3f078-80f4-4ae3-ba29-99302c0cc23d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.517842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3f078-80f4-4ae3-ba29-99302c0cc23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-fdb3f078-80f4-4ae3-ba29-99302c0cc23d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:20.522720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:20.523775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 11:10:20.524859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:20.526774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 242/479] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:20.532754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:20.648119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d294cfc-a724-4987-a57a-4fe0c3dd1d69 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:20.674876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:20.702290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646e89-ca30-4821-93bb-d6f5c321788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:20.703672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646e89-ca30-4821-93bb-d6f5c321788a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:20.704112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646e89-ca30-4821-93bb-d6f5c321788a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:20.704597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646e89-ca30-4821-93bb-d6f5c321788a None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:20.705375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646e89-ca30-4821-93bb-d6f5c321788a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:20.705781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646e89-ca30-4821-93bb-d6f5c321788a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:20.708107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646e89-ca30-4821-93bb-d6f5c321788a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:20.720813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 238/480] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:21.275892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b93e-35f1-482e-aa86-80157e45383e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.276582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b93e-35f1-482e-aa86-80157e45383e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.276582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b93e-35f1-482e-aa86-80157e45383e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.277863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 243/481] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:21.285419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65eba1-2420-40d9-8dc9-2563e2c33263 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.285942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65eba1-2420-40d9-8dc9-2563e2c33263 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.286091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65eba1-2420-40d9-8dc9-2563e2c33263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:21.310482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1f65eba1-2420-40d9-8dc9-2563e2c33263 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:21.311740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1f65eba1-2420-40d9-8dc9-2563e2c33263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:21.399315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 239/482] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:21.806724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792b93e-35f1-482e-aa86-80157e45383e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:21.940271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792b93e-35f1-482e-aa86-80157e45383e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:21.987222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2cb1-7e20-4480-ae36-46324a00e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:21.987862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cb1-7e20-4480-ae36-46324a00e77b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:21.988144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cb1-7e20-4480-ae36-46324a00e77b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:21.988449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2cb1-7e20-4480-ae36-46324a00e77b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.003002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:22.006113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b2cb1-7e20-4480-ae36-46324a00e77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-038b2cb1-7e20-4480-ae36-46324a00e77b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:22.010942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:22.011808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:22.020787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 244/483] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:22.021477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65eba1-2420-40d9-8dc9-2563e2c33263 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:22.043758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452c649-f44b-4747-bdc8-d89649a0e07e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.044048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452c649-f44b-4747-bdc8-d89649a0e07e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.044353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452c649-f44b-4747-bdc8-d89649a0e07e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.045933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 245/484] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:22.051976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe856a-0888-44f5-953f-eb2bc7d7b748 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.052494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe856a-0888-44f5-953f-eb2bc7d7b748 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.052937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe856a-0888-44f5-953f-eb2bc7d7b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.071222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fabe856a-0888-44f5-953f-eb2bc7d7b748 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:22.072753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fabe856a-0888-44f5-953f-eb2bc7d7b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:22.205284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65eba1-2420-40d9-8dc9-2563e2c33263 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:22.207126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 246/485] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:10:22.223535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:22.269464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:22.270085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.270370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.270645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.271319 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:22.271621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:22.273029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:22.285041 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 240/486] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:22.290519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe856a-0888-44f5-953f-eb2bc7d7b748 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:22.423762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe856a-0888-44f5-953f-eb2bc7d7b748 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:22.458747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:22.470136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:22.471134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.471576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.472005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.490096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:22.491807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:22.508404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:22.509317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:22.510147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:22.510147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:22.510147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:22.511988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 247/487] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:22.517483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:22.540828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:22.680074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7751f-0797-41d2-be8a-f6982e99e5c1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:22.684915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a45e3f-6fb0-4b3a-bc70-92c3ef666082 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:22.715487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3ee07-efb6-4ae4-84fc-7841d4cbccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:22.716112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ee07-efb6-4ae4-84fc-7841d4cbccdd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.716425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ee07-efb6-4ae4-84fc-7841d4cbccdd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.716754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ee07-efb6-4ae4-84fc-7841d4cbccdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.727572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3ee07-efb6-4ae4-84fc-7841d4cbccdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:22.729358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7be06-42fa-46ac-9e62-ed10cf0a7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:22.730082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7be06-42fa-46ac-9e62-ed10cf0a7140 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.730469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7be06-42fa-46ac-9e62-ed10cf0a7140 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.730844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7be06-42fa-46ac-9e62-ed10cf0a7140 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.731601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7be06-42fa-46ac-9e62-ed10cf0a7140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:22.732008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7be06-42fa-46ac-9e62-ed10cf0a7140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f9a3ee07-efb6-4ae4-84fc-7841d4cbccdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:22.732988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:22.733860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:22.735610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:22.736197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7be06-42fa-46ac-9e62-ed10cf0a7140 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:22.739533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 248/488] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:22.740872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dedf-6f73-492b-867e-160fd5615136 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.741156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dedf-6f73-492b-867e-160fd5615136 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.741430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dedf-6f73-492b-867e-160fd5615136 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.742774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 249/489] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:22.743461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dedf-6f73-492b-867e-160fd5615136 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:22.758323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 241/490] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:22.759848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe864-714a-4221-830d-8285e63467e5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.760197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe864-714a-4221-830d-8285e63467e5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.760502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfe864-714a-4221-830d-8285e63467e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.783226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3fdfe864-714a-4221-830d-8285e63467e5 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:22.784546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3fdfe864-714a-4221-830d-8285e63467e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:22.802561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:22.810141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:22.864243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 242/491] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:22.864243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe864-714a-4221-830d-8285e63467e5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:22.885083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dedf-6f73-492b-867e-160fd5615136 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:22.936117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2b73c-5508-4efe-919e-3eb35a3afadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:22.936771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2b73c-5508-4efe-919e-3eb35a3afadf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.938257 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2b73c-5508-4efe-919e-3eb35a3afadf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.938623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2b73c-5508-4efe-919e-3eb35a3afadf None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.939379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2b73c-5508-4efe-919e-3eb35a3afadf None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:22.939764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2b73c-5508-4efe-919e-3eb35a3afadf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:22.942152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2b73c-5508-4efe-919e-3eb35a3afadf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:22.953952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 250/492] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:22.955403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02fa75-d359-413a-aef6-45a63bb2e21a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:22.955692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02fa75-d359-413a-aef6-45a63bb2e21a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:22.955969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02fa75-d359-413a-aef6-45a63bb2e21a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:22.958516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 251/493] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:22.959882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02fa75-d359-413a-aef6-45a63bb2e21a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:22.971477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfe864-714a-4221-830d-8285e63467e5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.019500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07cff8-c652-4e20-b8be-1ce4d58d0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.020545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cff8-c652-4e20-b8be-1ce4d58d0eaa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.020908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cff8-c652-4e20-b8be-1ce4d58d0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.021753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07cff8-c652-4e20-b8be-1ce4d58d0eaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.031868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07cff8-c652-4e20-b8be-1ce4d58d0eaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:23.033907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07cff8-c652-4e20-b8be-1ce4d58d0eaa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4f07cff8-c652-4e20-b8be-1ce4d58d0eaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:23.052816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:23.053817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:23.054724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 243/494] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:10:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:23.058854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf137c2-8908-4c99-94b4-7498fa7a7b4f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.058854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf137c2-8908-4c99-94b4-7498fa7a7b4f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.058854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf137c2-8908-4c99-94b4-7498fa7a7b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.076356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-caf137c2-8908-4c99-94b4-7498fa7a7b4f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:23.077547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-caf137c2-8908-4c99-94b4-7498fa7a7b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:23.092831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02fa75-d359-413a-aef6-45a63bb2e21a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.093369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.096415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.137797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.138451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.139213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.139504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.153978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:23.155888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 244/495] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:23.155888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf137c2-8908-4c99-94b4-7498fa7a7b4f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.156344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:23.176359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:23.178361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:23.179478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:23.179478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:23.179478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:23.183777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 252/496] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:23.184707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.282700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf137c2-8908-4c99-94b4-7498fa7a7b4f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.304293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b91b8-1eca-407b-8668-a121c0c267ed None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.333526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d4730-23e6-462e-8ccc-5079fdd546fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.334400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4730-23e6-462e-8ccc-5079fdd546fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.334689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4730-23e6-462e-8ccc-5079fdd546fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.334988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4730-23e6-462e-8ccc-5079fdd546fd None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.336388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4730-23e6-462e-8ccc-5079fdd546fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:23.336810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4730-23e6-462e-8ccc-5079fdd546fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:23.338260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4730-23e6-462e-8ccc-5079fdd546fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:23.340169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.340895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.341243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.341583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.352753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:23.358099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:23.359474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:23.360681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 253/497] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:23.361325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.380508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.381343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 245/498] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:23.383118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688638-8497-48df-bbbb-f73ab835f2e7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.383414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688638-8497-48df-bbbb-f73ab835f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.383695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688638-8497-48df-bbbb-f73ab835f2e7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.385662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 246/499] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:23.389358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45688638-8497-48df-bbbb-f73ab835f2e7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.400470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.470345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5596d4a-da42-47bf-931a-3c70990f1293 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.494000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45688638-8497-48df-bbbb-f73ab835f2e7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.503502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.504103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.504412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.504683 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.505334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:23.505640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:23.507005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:23.519195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 254/500] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:23.519997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.527738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02381b-b1ee-4714-aa15-18d90545d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.528391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02381b-b1ee-4714-aa15-18d90545d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.528701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02381b-b1ee-4714-aa15-18d90545d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.528976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02381b-b1ee-4714-aa15-18d90545d6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.529673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02381b-b1ee-4714-aa15-18d90545d6a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:23.529979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02381b-b1ee-4714-aa15-18d90545d6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:23.532395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02381b-b1ee-4714-aa15-18d90545d6a3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:23.540834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 247/501] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:23.541971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca98d5f-dad8-439b-8a77-164623ae5882 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.542257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca98d5f-dad8-439b-8a77-164623ae5882 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.542525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca98d5f-dad8-439b-8a77-164623ae5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.560001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0ca98d5f-dad8-439b-8a77-164623ae5882 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:23.561217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ca98d5f-dad8-439b-8a77-164623ae5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:23.600165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.622677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d125fa-5049-4b74-a298-ab118a1d8e9c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.624178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.629275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 248/502] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:23.630078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca98d5f-dad8-439b-8a77-164623ae5882 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.661269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.661877 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.662434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.662434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.733813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:23.736046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:23.739733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca98d5f-dad8-439b-8a77-164623ae5882 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.778236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.778955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.779150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.779427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.791071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:23.795884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:23.796889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:23.798208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 249/503] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:23.799539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.822655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.846933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 255/504] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:23.851521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.876957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:23.920095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c53eda-1fd9-4564-ab84-3c8a9578b835 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.950872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49b41f-4fc2-412f-b71c-ff50ce990214 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:23.954586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.955213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.955493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.955766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:23.962681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:23.964115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:23.975891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:23.976970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 250/505] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:23.977834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:23.989402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:23.989968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:23.990257 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:23.990533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.001018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.002480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:24.018926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:24.019820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:24.020968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:24.020968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.020968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:24.020968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 256/506] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:24.020968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.052828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.085704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd877-ba3f-4dd1-8007-475e882ad744 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.105036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.119357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.119959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.120263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.120541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.121192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:24.121498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.122857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.124092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9ae91-6398-423b-906b-42fdd961bc5f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.131682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 251/507] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:24.132493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.162721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.163345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.163624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.163900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.174949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.176431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:24.191283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:24.192385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:24.193293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:24.193293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.193293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:24.196520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 257/508] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:24.197322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.239810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2ef8-4c67-4dfa-a88e-afca16bbd94d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.273393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.274018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.274296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.274565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.280429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.285354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.286815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.301131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33065f64-0c23-46be-b0e8-2633c17b0351 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:24.301827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:24.302866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:24.304274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:24.304274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.304274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:24.304274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 252/509] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:24.304274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.339850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.340640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.341244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.341525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.341800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.342526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:24.342834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.345382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.386727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 258/510] 10.222.0.86 () {56 vars in 1137 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:24.386727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.405473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d4af8-cd67-40e9-a31c-a97ef3dd2602 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.439900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.440553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.440829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.441099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.441739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:24.442038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.443385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.456405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 253/511] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:24.457058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.483822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b15fd-f823-4d97-8703-cdb54d4a315e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.517117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.517671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.517955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.518229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.524675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.528333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.529818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:24.544973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:24.545870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:24.547476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:24.547476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:24.547476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:24.547476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 259/512] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:24.547981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.553598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.560568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67983510-1df7-4e10-8a9f-6d932ca2c94c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.597380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.597995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.598280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.598555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.599208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:24.599514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.600973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.612610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 254/513] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:24.613383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.657358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5e074-fe2c-4a28-b311-c60b9d082d33 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.690047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.690652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.690970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.691241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.691891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:24.692201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.693615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.705942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 260/514] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:24.706735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.712897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f61cd4-c917-4e30-8717-0911953f8101 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.747164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.747772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.748056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.748370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.756915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.772562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.807203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab033d6-2e21-4b10-aa83-af33d17ddd2e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.815850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.817333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.840108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.840760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.841040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.841317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.849595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:24.851026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:24.863594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:24.864531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:24.865437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 261/515] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:24.865998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.925503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 255/516] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:24.925503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:24.965429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c56e3-3a60-4474-a54f-75b12a72f139 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:24.975975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.976624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:24.998158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:24.998754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:24.999033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:24.999307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:24.999984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:25.000311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.001676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.013571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 262/517] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:25.014338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.021264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fa65f-f3b2-4d60-89d7-3f51d474451b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.056526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.057157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.057439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.057717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.064978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.066419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:25.078893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:25.079876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:25.081042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:25.084673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 256/518] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:25.085439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.115284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd128f7-3fc5-437a-8444-b68999aab317 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.149622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.150226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.150517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.150790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.151421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.152896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.185874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d517309-d6d6-4b1d-8882-530b46b7c3a5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.199523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:25.220579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.221192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.221474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.221747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.222473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:25.222780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.224230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.240807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 257/519] 10.222.0.86 () {56 vars in 1139 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:25.241590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.256549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 263/520] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:10:25 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:25.257564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.288460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:25.369117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18b436-654b-4aa0-907e-bc3d172c3276 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.379670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba5234-afed-4127-866b-aec990eaeff0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.409545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.410221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.410512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.410792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.422353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.423606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.423606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.423812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.425127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.427137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.431022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.432490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:25.445131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:25.446089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:25.447044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:25.447044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:25.447044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:25.447044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 258/521] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:25.447044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:25.447861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:25.449213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 264/522] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:25.450299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.477871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:25.549041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:25.558317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7f4a-a9d1-4f7c-acdc-7a5ecae4981b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.566270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fe37-48b4-467b-8413-2aba305a0254 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.595317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.595935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.596235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.596542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.597506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:25.597630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.598969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.609185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.610520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.610872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.611216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.621889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 259/523] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:25.621889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.690292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.691817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.709282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:25.726082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0057-09d5-4fe8-bde7-ebf2b0feb9cc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.763384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.764058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.764388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.764668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.765485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:25.765828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.767168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.785889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 260/524] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:25.785889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.792071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:25.813455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 265/525] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:25.813455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.914519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684cbe0-6bb5-430b-9251-584406e44703 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.938260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c82e-ce1f-4c41-af03-e632b09392bb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:25.951352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.952145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.952539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.952889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.953690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=748eb93057e245c1b8183dbe0340fa3f) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:25.954070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.955830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:25.972299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 266/526] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/role_assignments?user.id=748eb93057e245c1b8183dbe0340fa3f&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:25.972299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:25.985163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:25.986079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:25.986443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:25.986852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:25.987700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:25.988076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:25.989885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.019522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 261/527] 10.222.0.86 () {56 vars in 1137 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:26.020623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.024071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.040773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.110077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed321ff-9787-4442-b95f-a20c250762bb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.141774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac8dc-9fb6-485d-b4df-af82d2eeeb7b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.148035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.148846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.149198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.149546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.157452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.159210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:26.173241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:26.174087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:26.174919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 267/528] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:26.176010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.185102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.185996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.186541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.187579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.199417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.201199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:26.221362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:26.222302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:26.223156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:26.223156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:26.223156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:26.225504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 262/529] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:26.226499 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.287346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608f66-4b1b-4dfc-8925-74048428367c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.293902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.299360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.325609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.326318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.326672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.327104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.339518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa857de-8ba3-4e38-a97e-4092f149cc4a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.376618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.377577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.378038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.378481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.379378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:26.379877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.381666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.397454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 263/530] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:26.398715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.404434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.406517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.505346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1a9a-d0f4-4e6e-8572-6e1942595fd4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.516417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 268/531] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:26.517322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.529243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.542962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.543882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.544446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.544914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.545747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:26.546345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.548333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.560998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 264/532] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:26.563389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.568555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.622480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af3c8-fb0c-4ea0-b3dc-74592acf8392 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.658994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.659599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.659882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.660158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.660926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=514818f5b23c4234b259e5b47e698a98) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:26.661240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.662681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.668914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 269/533] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/role_assignments?user.id=514818f5b23c4234b259e5b47e698a98&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:26.669829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.677842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc486d7-e326-412c-a11e-525b7f8c5ced None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.720027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.721151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.721726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.722191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.735581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.737606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.754398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:26.756115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:26.757004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:26.757829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:26.757829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:26.757829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:26.760021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 265/534] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:26.773960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.787953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807f9b9-f639-4ac0-a58b-dc465bc01dd2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.825499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:26.826142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:26.826427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:26.826704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:26.832581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:26.834908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:26.836468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:26.848724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:26.849659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:26.850483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:26.854667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 270/535] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:26.856184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:26.962162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b333-aa25-4838-abcd-f40ef57f8ba7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:26.966784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18ca33-8cf5-4a2b-a06d-ab9df96fb6c2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.006238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.006418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.006776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.006879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.007061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.007156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.007332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.007427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.008042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:27.008142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:27.008390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.009358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.009785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.010872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.012889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:27.025377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 266/536] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:27.033300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.049170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 271/537] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:27.054775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.200634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:27.226607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7922e-9de6-47e8-9296-64113850a9ec None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.242134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713f10-2d62-47c4-8507-ff649a23b626 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.270463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05a200-92ba-4eac-8772-f80314688aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.271449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05a200-92ba-4eac-8772-f80314688aaa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.271923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05a200-92ba-4eac-8772-f80314688aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.272412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05a200-92ba-4eac-8772-f80314688aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.284935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05a200-92ba-4eac-8772-f80314688aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.286651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05a200-92ba-4eac-8772-f80314688aaa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4f05a200-92ba-4eac-8772-f80314688aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:27.302165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:27.303002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:27.303839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:27.306444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 267/538] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:27.307347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371f073-53a1-4161-97b7-a49c968ec3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.307962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371f073-53a1-4161-97b7-a49c968ec3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.308363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371f073-53a1-4161-97b7-a49c968ec3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.308466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7c29-fdc8-42a1-8141-6c2f1ddc8623 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.308635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371f073-53a1-4161-97b7-a49c968ec3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.309091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7c29-fdc8-42a1-8141-6c2f1ddc8623 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.309426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371f073-53a1-4161-97b7-a49c968ec3f9 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=bfd4d0f2f95b4861888c33b0c66c602b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:27.309746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371f073-53a1-4161-97b7-a49c968ec3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.309938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7c29-fdc8-42a1-8141-6c2f1ddc8623 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.311322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371f073-53a1-4161-97b7-a49c968ec3f9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.312352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 268/539] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:27.313228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7c29-fdc8-42a1-8141-6c2f1ddc8623 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.322576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 272/540] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:27 2022] GET /identity/v3/role_assignments?user.id=bfd4d0f2f95b4861888c33b0c66c602b&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:27.324080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05307d-305e-4e74-9cbf-cbdae8d6a839 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.324405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05307d-305e-4e74-9cbf-cbdae8d6a839 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.324738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05307d-305e-4e74-9cbf-cbdae8d6a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.350671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8c05307d-305e-4e74-9cbf-cbdae8d6a839 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:27.352166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8c05307d-305e-4e74-9cbf-cbdae8d6a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:27.423590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:27.441435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 273/541] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:27.492973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7c29-fdc8-42a1-8141-6c2f1ddc8623 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.540595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.541228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.541508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.541782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.542541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:27.542850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.544313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.566654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 269/542] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:27.573227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05307d-305e-4e74-9cbf-cbdae8d6a839 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.723594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05307d-305e-4e74-9cbf-cbdae8d6a839 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.774926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.775543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.775829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.776109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.776872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=0bc29638c1994ab09ea1b1f7c7f247ae) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:27.777187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:27.778645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:27.783869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:27.785440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 274/543] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:27 2022] GET /identity/v3/role_assignments?user.id=0bc29638c1994ab09ea1b1f7c7f247ae&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:27.795406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:27.916273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45707ef-558a-4322-9378-9eebeb77b948 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:27.957484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:27.958140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:27.958418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:27.958691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:27.977624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:27.982749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:27.983626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:27.984786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 270/544] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:27.990305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.051979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:28.110565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fed5f-6047-41fd-b254-c9d15c1951c1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.160055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757dc3f-2c6e-40ec-a5f2-907c0134b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.160787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757dc3f-2c6e-40ec-a5f2-907c0134b836 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.161074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757dc3f-2c6e-40ec-a5f2-907c0134b836 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.161351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757dc3f-2c6e-40ec-a5f2-907c0134b836 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.162032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757dc3f-2c6e-40ec-a5f2-907c0134b836 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:28.162342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757dc3f-2c6e-40ec-a5f2-907c0134b836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.163734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757dc3f-2c6e-40ec-a5f2-907c0134b836 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.173787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 275/545] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:28.179118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.217211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c36d7a-e777-466d-b52f-72ac3118b7b2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.217718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c36d7a-e777-466d-b52f-72ac3118b7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.218695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c36d7a-e777-466d-b52f-72ac3118b7b2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.223562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 276/546] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:28.229473 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc66bfa-4fef-4475-938e-88506aef4433 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.229979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc66bfa-4fef-4475-938e-88506aef4433 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.230392 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc66bfa-4fef-4475-938e-88506aef4433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.263105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bfc66bfa-4fef-4475-938e-88506aef4433 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:28.266115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bfc66bfa-4fef-4475-938e-88506aef4433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:28.309297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:28.376005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dce34-fa96-4ef0-a33b-0f0e5bbef537 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.393535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 277/547] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 11:10:28.432289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.433191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.433613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.434021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.457220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.458680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:28.476791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:28.477731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:28.478656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:28.478656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:28.478656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:28.478656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 271/548] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:28.483829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc66bfa-4fef-4475-938e-88506aef4433 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.534122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:28.601484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc66bfa-4fef-4475-938e-88506aef4433 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.650235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.651228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.651732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.652677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.653678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:28.654187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.656409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.669763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 278/549] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:28.675807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.807517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.819824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e28fb-a735-43f7-99fe-b44934162a21 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.850737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:28.880286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:28.880840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:28.881127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:28.881397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:28.894008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:28.896466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:28.913263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:28.914669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:28.915569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:28.916088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 272/550] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:28.923559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:28.994296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ff7a-cfea-4da6-ab4b-14b092482722 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:28.997486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.063324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.063951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.064281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.064562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.074916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:29.080058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:29.081186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:29.081987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 279/551] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:29.087031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.112132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c77db-0fcc-4084-a25d-4d2f3bad6451 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.184857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.185399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.185781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.186065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.187536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:29.187844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.189316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.195885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136e5ec-5ecb-4992-8b01-f3142359743a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.231782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 273/552] 10.222.0.86 () {56 vars in 1135 bytes} [Thu Aug 18 11:10:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:29.238222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.260366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160df245-f879-4b5c-aa9a-586cfa9ed689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.261025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160df245-f879-4b5c-aa9a-586cfa9ed689 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.261303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160df245-f879-4b5c-aa9a-586cfa9ed689 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.261577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160df245-f879-4b5c-aa9a-586cfa9ed689 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.262306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160df245-f879-4b5c-aa9a-586cfa9ed689 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:29.262614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160df245-f879-4b5c-aa9a-586cfa9ed689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.264047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160df245-f879-4b5c-aa9a-586cfa9ed689 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.273985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 280/553] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:29.281435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce271e9f-62e8-4575-a394-41a9015d603d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.281965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce271e9f-62e8-4575-a394-41a9015d603d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.282287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce271e9f-62e8-4575-a394-41a9015d603d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.283846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 281/554] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:29.284599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce271e9f-62e8-4575-a394-41a9015d603d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.300607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.313375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.365643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f07bb5-a493-4a0a-9237-d7ae2fd7dd75 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.389531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce271e9f-62e8-4575-a394-41a9015d603d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.405373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.407054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.407522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.407976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.427854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fd92-a87e-4abc-998d-fed7f00761da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.428522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fd92-a87e-4abc-998d-fed7f00761da None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.428801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fd92-a87e-4abc-998d-fed7f00761da None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.429070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fd92-a87e-4abc-998d-fed7f00761da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.439756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4fd92-a87e-4abc-998d-fed7f00761da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.441157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4fd92-a87e-4abc-998d-fed7f00761da None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cff4fd92-a87e-4abc-998d-fed7f00761da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:29.456805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:29.457782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:29.458657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:29.458657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:29.458657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:29.462735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 282/555] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:29.464018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73369bf-e5bc-4e7d-86a1-4302a62cebe5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.464352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73369bf-e5bc-4e7d-86a1-4302a62cebe5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.464632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73369bf-e5bc-4e7d-86a1-4302a62cebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.483485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d73369bf-e5bc-4e7d-86a1-4302a62cebe5 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:29.485168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d73369bf-e5bc-4e7d-86a1-4302a62cebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:29.492407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.494278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.540664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.563836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 283/556] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:29.563836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73369bf-e5bc-4e7d-86a1-4302a62cebe5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.567286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.619466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 274/557] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 11:10:29.625807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.668261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73369bf-e5bc-4e7d-86a1-4302a62cebe5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.697439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.697976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.698615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.698615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.699201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:29.699509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.700893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.713592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 284/558] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:29.720049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.780333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33de69-7154-4dc2-ae79-7255a162e398 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.789202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.825067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acb64-dbe6-4f7b-8683-76881c583253 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:29.847392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.848438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.848978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.849535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.852966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:29.863236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc69af-86c4-457e-9d5d-e3d16daf914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:29.863936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc69af-86c4-457e-9d5d-e3d16daf914b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.864181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc69af-86c4-457e-9d5d-e3d16daf914b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.864465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc69af-86c4-457e-9d5d-e3d16daf914b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.865533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.867516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.872784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc69af-86c4-457e-9d5d-e3d16daf914b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:29.874239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc69af-86c4-457e-9d5d-e3d16daf914b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:29.885420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:29.886364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:29.887241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:29.887241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:29.887241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9cdc69af-86c4-457e-9d5d-e3d16daf914b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:29.887406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:29.888794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:29.891480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 285/559] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:29.892937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 275/560] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:29.893076 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484a7ae-5cdf-49e6-a9c4-f78fe6def885 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:29.893279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484a7ae-5cdf-49e6-a9c4-f78fe6def885 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:29.893562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484a7ae-5cdf-49e6-a9c4-f78fe6def885 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:29.895039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 286/561] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:29.900391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:29.900529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484a7ae-5cdf-49e6-a9c4-f78fe6def885 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.020991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484a7ae-5cdf-49e6-a9c4-f78fe6def885 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.024854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8a609-d5cd-47b3-aa51-ee5df0ec8272 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.044294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.052136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece4222-1538-4968-8ad7-09514bcd5743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.052853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece4222-1538-4968-8ad7-09514bcd5743 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.053135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece4222-1538-4968-8ad7-09514bcd5743 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.053415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece4222-1538-4968-8ad7-09514bcd5743 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.054147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece4222-1538-4968-8ad7-09514bcd5743 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:30.054504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece4222-1538-4968-8ad7-09514bcd5743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.055919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece4222-1538-4968-8ad7-09514bcd5743 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.060354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb2a67-0761-4a61-847a-99fc9780c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.064782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb2a67-0761-4a61-847a-99fc9780c368 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.064782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb2a67-0761-4a61-847a-99fc9780c368 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.064782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb2a67-0761-4a61-847a-99fc9780c368 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.064782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb2a67-0761-4a61-847a-99fc9780c368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:30.064782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb2a67-0761-4a61-847a-99fc9780c368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.064782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb2a67-0761-4a61-847a-99fc9780c368 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.073622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 287/562] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:30.074894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1c16-1d10-4155-837e-ea757b788d07 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.075185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1c16-1d10-4155-837e-ea757b788d07 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.075464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1c16-1d10-4155-837e-ea757b788d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.081373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 276/563] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:30.081373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7b41-9d4a-41a7-8327-c2460e3c3b42 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.081373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7b41-9d4a-41a7-8327-c2460e3c3b42 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.081373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7b41-9d4a-41a7-8327-c2460e3c3b42 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.081373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 277/564] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:30.081373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7b41-9d4a-41a7-8327-c2460e3c3b42 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.096242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b5ad1c16-1d10-4155-837e-ea757b788d07 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:30.097453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b5ad1c16-1d10-4155-837e-ea757b788d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:30.132388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.164983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 288/565] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:30.166022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad1c16-1d10-4155-837e-ea757b788d07 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.190295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7b41-9d4a-41a7-8327-c2460e3c3b42 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.234674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.235452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.235872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.236279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.247286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:30.253298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:30.254429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:30.255443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:30.256602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 278/566] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:30.260385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.277963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad1c16-1d10-4155-837e-ea757b788d07 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.296165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.315426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585f69-b0f3-4feb-aeec-df7707b71e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.316057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585f69-b0f3-4feb-aeec-df7707b71e28 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.316377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585f69-b0f3-4feb-aeec-df7707b71e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.316655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585f69-b0f3-4feb-aeec-df7707b71e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.323953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585f69-b0f3-4feb-aeec-df7707b71e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.325433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585f69-b0f3-4feb-aeec-df7707b71e28 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-05585f69-b0f3-4feb-aeec-df7707b71e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:30.336914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:30.337899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:30.338792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:30.342778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 289/567] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:30.344583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5790-1fba-4e10-b483-c0136ded3d5f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.344869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5790-1fba-4e10-b483-c0136ded3d5f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.345136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f5790-1fba-4e10-b483-c0136ded3d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.364142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-739f5790-1fba-4e10-b483-c0136ded3d5f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:30.365345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-739f5790-1fba-4e10-b483-c0136ded3d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:30.368894 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ea7a5-c76e-4b9e-9d2f-cec96fdabc20 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.379239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.404823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.405519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.405806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.406090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.417533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.418986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.435732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 290/568] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:30.436588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:30.438140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:30.439009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:30.439009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:30.439009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:30.439009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 279/569] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:30.439448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.439636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f5790-1fba-4e10-b483-c0136ded3d5f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.549402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f5790-1fba-4e10-b483-c0136ded3d5f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.555088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c2ba-6ad6-4503-8696-88e2c3950dee None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.558069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.587414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.588264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.588695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.589142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.589950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:30.590065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.590508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.590661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.590948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.591221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.592002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:30.592338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.593603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.594453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.607379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 280/570] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:30.607379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.607723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 291/571] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:30.609299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.633313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.719450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a64d-2661-4953-a810-7c47a87466fc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.721634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07d02d-82cf-40fc-9a9d-08d8e326bc1a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.753932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.754564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.754851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.755130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.755357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.755959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.756268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.756549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.757193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:30.757501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.758856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.765694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:30.770390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:30.771389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:30.772453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:30.773208 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 292/572] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:30.773281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 281/573] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:30.773281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.776546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.806091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.855496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:30.875663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fac1-23fe-43e8-afc1-c53d881de183 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.879110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76cc7-e39d-4dcd-ad01-bca0866b4b3b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:30.943421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.943736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:30.944057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.944374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:30.944469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.944661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:30.944765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.944939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:30.945675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=3fecc15bbe7f4a71ac8821ea057153b2) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:30.945991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.947431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.953140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 282/574] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/role_assignments?user.id=3fecc15bbe7f4a71ac8821ea057153b2&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:30.953927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:30.959326 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:30.961001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:30.984520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:30.985680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:30.991593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:30.991593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:30.991593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:30.991593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 293/575] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:30.991593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.071546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebe7a7-270a-4da7-b6bd-72aab7bd732d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.086665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.107591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecb7c3-548b-4e14-aba0-042339d1e786 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.110246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.111240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.111240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.111738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.122412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:31.128175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:31.129304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:31.130312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:31.134623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 283/576] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:31.135186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.139691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.151959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.152669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.152952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.153230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.161116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.162559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:31.175151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:31.176053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:31.176977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 294/577] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:31.177462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.252707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e089bd-053c-426c-b373-57a340eb9b2d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.293071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.293681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.293957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.294226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.294884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:31.295184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.295342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5ab3f-0f36-428c-b0ad-67c2333416df None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.296669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.309112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 284/578] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:31.309112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.338817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.339461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.339822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.340102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.340783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:31.341089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.342447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.352713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.355810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 295/579] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:31.356978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.378554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.417082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b166f-2369-432f-92f1-b90a2a1cebfe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.459774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.460422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.460874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.461157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.462392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:31.462715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.464088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.464197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33877731-972b-46cc-8cf3-b098a0040d30 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.473063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 285/580] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:31.473869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.505390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.506002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.506287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.506567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.507256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:31.507565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.509022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.521830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 296/581] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:31.522526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.583907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222945c-6461-4c09-967c-4225e10d1de5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.584810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.613147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.621355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.621993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.622277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.622559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.629532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b367fd-4c9f-4dfa-be8c-71bc15ef27c0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.634384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.635897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:31.651902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:31.653130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:31.654035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:31.654035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:31.654035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:31.654035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 286/582] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:31.654264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.669585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.670221 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.670508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.670778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.678263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.679694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:31.690599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:31.691537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 297/583] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:31.692516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.759692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eead6a0-a34f-4b96-b7d5-332d478e4ddd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.800051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e746f90-b848-44b5-9dc5-476c15363acd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:31.802109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.803679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.804037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.804422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.818870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.820369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.821721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.836701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:31.837375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:31.837655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:31.837931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/748eb93057e245c1b8183dbe0340fa3f/roles/6cb47f6dfcc046b9b43619b5f16931ad` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:31.838912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:31.839861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:31.840785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:31.840785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:31.840785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:31.840785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 287/584] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:31.840785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:31.860924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=748eb93057e245c1b8183dbe0340fa3f, role_id=6cb47f6dfcc046b9b43619b5f16931ad)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:31.863100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:31.874851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:31.907350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 298/585] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:31 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/748eb93057e245c1b8183dbe0340fa3f/roles/6cb47f6dfcc046b9b43619b5f16931ad => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:31.908468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.005884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971d190-9496-43eb-a236-84bfc1d03273 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.048007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b1762-fa94-4b56-989e-a20325486828 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.062160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.063223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.063518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.063801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.064781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:32.065096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.066755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.084319 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 288/586] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:32.085175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.099224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.100359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.100653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.100999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.102218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:32.102654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.104272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.131344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 299/587] 10.222.0.86 () {56 vars in 1137 bytes} [Thu Aug 18 11:10:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:32.132194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.176656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.193992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.210721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45690979-39a3-42e3-a63d-b55027f388db None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.254232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.254839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.255117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.255388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.256086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:32.256415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.257794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.275509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 289/588] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:32.275509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.289859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84282ed-d353-4510-a1b1-908b317e41b4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.330497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.331133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.331413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.331682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.340710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.342210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:32.358222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:32.359401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:32.360375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 300/589] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:32.361440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.410620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f9dc4-1de6-4b50-9f1a-8eeb3babcc07 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.446588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.447188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.447468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.447738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.459704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.461251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:32.479175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:32.480520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:32.481433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:32.481433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:32.481433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:32.484781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 290/590] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:32.485452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.488295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.490914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.505396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274a656-254f-43cb-9c62-15ddca7c1df4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.546985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.547981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.548551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.549027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.557753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.559570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:32.572714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:32.573693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:10:32.574611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:32.582317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 301/591] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:32.583584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.601034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde36cb2-58ef-4649-ba0d-8799e167842b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.638977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.639594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.640665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.641164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.641934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:32.642242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.644144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.664558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 291/592] 10.222.0.86 () {56 vars in 1139 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:32.665419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.696539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe47cb-ad53-4e66-b437-94bc737abcd5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.731867 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.735212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.736067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.736606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.737080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.737990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:32.738515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.740193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.753367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 302/593] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:32.754498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.766022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.780397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e7fca-4475-4145-986c-4956882e9ad9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.818697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.819419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.819972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.820392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.822278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:32.822686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.824234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.848890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 292/594] 10.222.0.86 () {56 vars in 1137 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:32.848890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.867985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f5a66-6680-4332-a8f2-8dfc37a09313 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.907549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.908330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.908945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.909053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:32.920535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:32.922711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:32.944101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:32.945183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:32.946066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:32.946066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:32.946066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:32.946066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 303/595] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:32.946500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:32.958435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc18028-0d0f-4d17-9df4-39576cb11499 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:32.979787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:32.997134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e421c1-f607-4a17-b6f8-531ac961aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:32.997876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e421c1-f607-4a17-b6f8-531ac961aa57 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:32.998228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e421c1-f607-4a17-b6f8-531ac961aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:32.998512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e421c1-f607-4a17-b6f8-531ac961aa57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.006153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e421c1-f607-4a17-b6f8-531ac961aa57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.007602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e421c1-f607-4a17-b6f8-531ac961aa57 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.012681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-68e421c1-f607-4a17-b6f8-531ac961aa57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:33.020116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:33.021020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:33.021885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 293/596] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:33.023471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56c31-2189-4ed4-b2fc-c85d56dfbbd7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.023471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56c31-2189-4ed4-b2fc-c85d56dfbbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.023471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb56c31-2189-4ed4-b2fc-c85d56dfbbd7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.028331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 294/597] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:33.028331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb56c31-2189-4ed4-b2fc-c85d56dfbbd7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.066957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b9f60-40b5-44e0-9a44-7d185d503188 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.103233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.104396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.104741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.105021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.117715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.119446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:33.134520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:33.135460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:33.136455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:33.136455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:33.136455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:33.136455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 304/598] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:33.136455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.143824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb56c31-2189-4ed4-b2fc-c85d56dfbbd7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.178565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352f8c5-94d4-45b6-a832-3861f3d16c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.179091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352f8c5-94d4-45b6-a832-3861f3d16c38 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.179375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352f8c5-94d4-45b6-a832-3861f3d16c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.179653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352f8c5-94d4-45b6-a832-3861f3d16c38 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.180339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352f8c5-94d4-45b6-a832-3861f3d16c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:33.180651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352f8c5-94d4-45b6-a832-3861f3d16c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.182014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352f8c5-94d4-45b6-a832-3861f3d16c38 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.193017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 295/599] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:33.194177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9be6-d568-4bd2-a49b-69d14936b399 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.194470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9be6-d568-4bd2-a49b-69d14936b399 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.194800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9be6-d568-4bd2-a49b-69d14936b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.217739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8fdf9be6-d568-4bd2-a49b-69d14936b399 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:33.219633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8fdf9be6-d568-4bd2-a49b-69d14936b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:33.257423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445dae-98a2-4fec-89cb-dd90abf71318 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.259646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.271597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.293773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 296/600] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:33.293951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.294681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.295066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.295279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9be6-d568-4bd2-a49b-69d14936b399 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.295527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.296613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:33.297046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.298575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.322182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 305/601] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:33.323355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.410466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9be6-d568-4bd2-a49b-69d14936b399 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.430070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5e70-4c6e-4a30-881f-ba9cf24ec7d0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.448056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.448986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.449480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.449935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.450777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:33.451260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.453540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.470151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.470151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.470151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.470151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.470966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 297/602] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:33.471997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.476543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.478057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:33.490309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:33.491226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:33.492168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 306/603] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:33.492695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.510149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.528679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.585268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c521f5a-03e5-48c0-956b-c53c52006567 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.605734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab89a-bb0b-4ca5-a5d5-1ecc344189bc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.620377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.621316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.621316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.621571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/514818f5b23c4234b259e5b47e698a98/roles/6cb47f6dfcc046b9b43619b5f16931ad` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.637469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=514818f5b23c4234b259e5b47e698a98, role_id=6cb47f6dfcc046b9b43619b5f16931ad)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.638907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.644663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.645328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.645612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.645966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.652994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.654419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:33.666157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:33.667105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 307/604] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:33.667985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.705358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 298/605] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:33 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/514818f5b23c4234b259e5b47e698a98/roles/6cb47f6dfcc046b9b43619b5f16931ad => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:33.717595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.791378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.804252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9b74b-d2bc-46d9-8115-3a88cd4c663c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.840883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:33.848938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.854828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.854828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.854828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.854828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:33.854828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:33.854828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:33.867894 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad19ce-fc37-4396-88ad-682df5978e98 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:33.869858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 308/606] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:33.872703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.913479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:33.914384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:33.914667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:33.914942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:33.927304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:33.932065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:33.933231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 299/607] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:33.937757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:33.989171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ac27c-7377-4735-a495-692d6ed49482 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.027449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ecf6-2d60-4037-b1ed-80c5ef51e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.028056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ecf6-2d60-4037-b1ed-80c5ef51e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.028369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ecf6-2d60-4037-b1ed-80c5ef51e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.028676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ecf6-2d60-4037-b1ed-80c5ef51e2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.029371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12ecf6-2d60-4037-b1ed-80c5ef51e2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:34.029678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12ecf6-2d60-4037-b1ed-80c5ef51e2d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:34.031905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12ecf6-2d60-4037-b1ed-80c5ef51e2d0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:34.044317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b0a2-cdb7-4377-a8b2-94f693745c92 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.044801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 309/608] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:34.045724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc468-bb9c-49a4-a20b-24d1c6c5133f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.046425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc468-bb9c-49a4-a20b-24d1c6c5133f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.046709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc468-bb9c-49a4-a20b-24d1c6c5133f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.052003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 310/609] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:34.052826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc468-bb9c-49a4-a20b-24d1c6c5133f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:34.068165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:34.085900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.087783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.087783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.087783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/bfd4d0f2f95b4861888c33b0c66c602b/roles/6cb47f6dfcc046b9b43619b5f16931ad` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.099093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:34.105163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=bfd4d0f2f95b4861888c33b0c66c602b, role_id=6cb47f6dfcc046b9b43619b5f16931ad)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:34.106731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:34.159650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc468-bb9c-49a4-a20b-24d1c6c5133f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.193636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808e95-f506-4e32-a05b-9a8df8aaaab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.194236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808e95-f506-4e32-a05b-9a8df8aaaab4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.194570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808e95-f506-4e32-a05b-9a8df8aaaab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.194843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808e95-f506-4e32-a05b-9a8df8aaaab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.195512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808e95-f506-4e32-a05b-9a8df8aaaab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:34.195813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808e95-f506-4e32-a05b-9a8df8aaaab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:34.197245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808e95-f506-4e32-a05b-9a8df8aaaab4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:34.203383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 300/610] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:33 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/bfd4d0f2f95b4861888c33b0c66c602b/roles/6cb47f6dfcc046b9b43619b5f16931ad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:34.203383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:34.220900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 311/611] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:34.222230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa8b1-8601-41f9-8ce5-c71f071d14dc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.222520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa8b1-8601-41f9-8ce5-c71f071d14dc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.225714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa8b1-8601-41f9-8ce5-c71f071d14dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.250799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-052fa8b1-8601-41f9-8ce5-c71f071d14dc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:34.251946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-052fa8b1-8601-41f9-8ce5-c71f071d14dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:34.330555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7693e44-d5b3-4da8-bed5-96edb3ff9b36 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.349051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 312/612] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:34.355804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa8b1-8601-41f9-8ce5-c71f071d14dc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:34.361734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:34.380457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.381144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.381430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.381709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/0bc29638c1994ab09ea1b1f7c7f247ae/roles/6cb47f6dfcc046b9b43619b5f16931ad` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.402470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=0bc29638c1994ab09ea1b1f7c7f247ae, role_id=6cb47f6dfcc046b9b43619b5f16931ad)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:34.404254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:34.484390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa8b1-8601-41f9-8ce5-c71f071d14dc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.519162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 301/613] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:34 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/0bc29638c1994ab09ea1b1f7c7f247ae/roles/6cb47f6dfcc046b9b43619b5f16931ad => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:34.536234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.540527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.540527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.540527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.550484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:34.552015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:34.580733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:34.581719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:34.583013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:34.583013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:34.583013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:34.583013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 313/614] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:34.589199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:34.651545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:34.681488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:34.738875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9379b92-714b-450a-b772-05914beeb64a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.762940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:34.784881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.785510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.785795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.786070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.786738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:34.787046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:34.788481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:34.805025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 302/615] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:34.810379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:34.859226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a25377-da86-43e2-bb1d-f2485a1dbaff None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.938753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:34.941283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:34.941927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:34.942209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:34.942483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:34.943390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188943d0-60bb-4e6c-9536-464cca5ddb37 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:34.966886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:34.974727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:34.975647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:34.976526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:34.980546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 314/616] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:34.987400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.018769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.019411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.019698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.020030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.041434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.042833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:35.066712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:35.068104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:35.069507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 303/617] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:35.077790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.104496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c2f62-4c67-476f-95dd-e6bdbdf924c2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:35.122487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:35.142065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.142999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.143447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.144097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.145023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:35.145527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.147121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.157264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 315/618] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:35.162587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.295257 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd121-ea63-4937-9ab7-5ad5406c79df None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:35.307887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed24f6-da12-4e7f-88ad-ee79035ed172 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:35.370054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.370697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.370982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.371272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.372406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.373011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.373287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.373559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.374480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:35.374786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.376237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.389463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.391644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.408529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 304/619] 10.222.0.86 () {56 vars in 1135 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:35.414331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:35.415275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:35.416143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:35.416143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:35.416143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:35.416143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 316/620] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:35.417040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.422024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.455172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:35.461801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:35.595291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a459-fbeb-43f9-aaa0-7fe014e3eebb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:35.613538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743f3ba-4490-439c-a5d6-cbd2687903c9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:35.661277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.662792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.663465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.664620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.665417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:35.665731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.667213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.671576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.672497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.673004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.673471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.679564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 317/621] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:35.684464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.686239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.689271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:35.704403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:35.705342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:35.706220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:35.706220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:35.706220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:35.712356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 305/622] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:35.714614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.791971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:35.798045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936237-b55d-4028-9cd8-ec91d5b2c482 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:35.832623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:35.835964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.836644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.836933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.837213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.845642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.847078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:35.859737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:35.861495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:35.862672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 318/623] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:35.866662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.895468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633de668-69c6-4f59-bc23-b964030a2a8b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:35.932649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b8873-8038-4685-8958-35b7969aa977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:35.933408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8873-8038-4685-8958-35b7969aa977 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.933709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8873-8038-4685-8958-35b7969aa977 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.934369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b8873-8038-4685-8958-35b7969aa977 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.935314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b8873-8038-4685-8958-35b7969aa977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:35.935629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b8873-8038-4685-8958-35b7969aa977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:35.937588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b8873-8038-4685-8958-35b7969aa977 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:35.955252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 306/624] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:35.956552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f622a9-a29d-40e5-bec8-8544ebfc8652 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:35.956841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f622a9-a29d-40e5-bec8-8544ebfc8652 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:35.957120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f622a9-a29d-40e5-bec8-8544ebfc8652 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:35.958551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 307/625] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:35.960667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f622a9-a29d-40e5-bec8-8544ebfc8652 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:35.986342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a57661-c42f-402e-a075-97e9bbc56756 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.031308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a4bc7-c422-4545-957d-ccd71919cbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.032594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4bc7-c422-4545-957d-ccd71919cbba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.032885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4bc7-c422-4545-957d-ccd71919cbba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.033167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4bc7-c422-4545-957d-ccd71919cbba None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.033909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a4bc7-c422-4545-957d-ccd71919cbba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:36.034223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a4bc7-c422-4545-957d-ccd71919cbba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:36.035881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a4bc7-c422-4545-957d-ccd71919cbba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:36.059108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 319/626] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:36.060433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5930-f037-4ddc-b848-aa9649eb51a0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.060728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5930-f037-4ddc-b848-aa9649eb51a0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.061011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5930-f037-4ddc-b848-aa9649eb51a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.080368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f622a9-a29d-40e5-bec8-8544ebfc8652 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.084477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3f7e5930-f037-4ddc-b848-aa9649eb51a0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:36.085692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3f7e5930-f037-4ddc-b848-aa9649eb51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:36.114634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:36.117933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:36.120693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.121424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.126956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.126956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.130052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:36.131597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:36.144597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:36.145822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:36.147028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:36.153463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 308/627] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:36.153463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:36.179012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 320/628] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:36.180176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5930-f037-4ddc-b848-aa9649eb51a0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:36.277055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd5b2-c082-4be9-80ff-8c90485c472d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.318144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.319193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.319627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.320052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.387675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:36.397999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5930-f037-4ddc-b848-aa9649eb51a0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.408393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:36.408393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:36.480318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee0fa7-fb0f-4089-83e8-827bfc9834a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.480903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0fa7-fb0f-4089-83e8-827bfc9834a1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.481184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0fa7-fb0f-4089-83e8-827bfc9834a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.481456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee0fa7-fb0f-4089-83e8-827bfc9834a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.482154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee0fa7-fb0f-4089-83e8-827bfc9834a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:36.482458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee0fa7-fb0f-4089-83e8-827bfc9834a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:36.485002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee0fa7-fb0f-4089-83e8-827bfc9834a1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:36.507112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:36.510760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 321/629] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:36.512075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696566af-1523-4758-a359-41cbbaa13604 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.512404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696566af-1523-4758-a359-41cbbaa13604 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.512693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696566af-1523-4758-a359-41cbbaa13604 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.514192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 322/630] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:36.514934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696566af-1523-4758-a359-41cbbaa13604 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:36.519501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 309/631] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:36.520376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:36.618696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:36.627186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696566af-1523-4758-a359-41cbbaa13604 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.630309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802c3de-3ccd-4e88-aa02-14f24feb8168 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.669456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.670575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.671373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.671657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/3fecc15bbe7f4a71ac8821ea057153b2/roles/6cb47f6dfcc046b9b43619b5f16931ad` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.672013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d3193-317c-4621-b880-1766aaa883bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.672766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d3193-317c-4621-b880-1766aaa883bb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.673056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d3193-317c-4621-b880-1766aaa883bb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.673333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d3193-317c-4621-b880-1766aaa883bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.685708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d3193-317c-4621-b880-1766aaa883bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:36.687474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=3fecc15bbe7f4a71ac8821ea057153b2, role_id=6cb47f6dfcc046b9b43619b5f16931ad)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:36.689050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fb0d3193-317c-4621-b880-1766aaa883bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:36.691136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:36.692290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:36.693162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 310/632] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:36.693865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c628a24-a888-49f0-9822-e2b4d99a31b1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.694082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c628a24-a888-49f0-9822-e2b4d99a31b1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.694568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c628a24-a888-49f0-9822-e2b4d99a31b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.712562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6c628a24-a888-49f0-9822-e2b4d99a31b1 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:36.713758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6c628a24-a888-49f0-9822-e2b4d99a31b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:36.779456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 311/633] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:36.781504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c628a24-a888-49f0-9822-e2b4d99a31b1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:36.781972 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 323/634] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:36 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/3fecc15bbe7f4a71ac8821ea057153b2/roles/6cb47f6dfcc046b9b43619b5f16931ad => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:36.783143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:36.863413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:36.888920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:36.917076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c628a24-a888-49f0-9822-e2b4d99a31b1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.925353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db0331-6357-47f4-a559-a6505c5c4a0d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:36.963817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e0e1d-78af-48d9-8886-9834a7c7e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.964889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e0e1d-78af-48d9-8886-9834a7c7e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.965311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03176209-d18a-45dd-9727-2f39eb02ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:36.965677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e0e1d-78af-48d9-8886-9834a7c7e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.966008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176209-d18a-45dd-9727-2f39eb02ea47 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.966293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176209-d18a-45dd-9727-2f39eb02ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.966567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176209-d18a-45dd-9727-2f39eb02ea47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.966863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e0e1d-78af-48d9-8886-9834a7c7e2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.968001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e0e1d-78af-48d9-8886-9834a7c7e2b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:36.968553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e0e1d-78af-48d9-8886-9834a7c7e2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:36.970375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e0e1d-78af-48d9-8886-9834a7c7e2b6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:36.979966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03176209-d18a-45dd-9727-2f39eb02ea47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:36.980588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 324/635] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:36.981531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03176209-d18a-45dd-9727-2f39eb02ea47 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:36.982365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d872b0-7cd5-4dbd-8429-16e4c9f5c3af None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:36.982884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d872b0-7cd5-4dbd-8429-16e4c9f5c3af None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:36.983892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d872b0-7cd5-4dbd-8429-16e4c9f5c3af None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:36.985880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 325/636] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:36.986909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d872b0-7cd5-4dbd-8429-16e4c9f5c3af None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-03176209-d18a-45dd-9727-2f39eb02ea47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:37.002446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:37.003630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:37.004770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:37.004770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:37.004770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:37.006444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 312/637] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:37.009519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047958d0-fa54-4c36-b567-ebcaa4039af3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.010058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047958d0-fa54-4c36-b567-ebcaa4039af3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.010487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047958d0-fa54-4c36-b567-ebcaa4039af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.040476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-047958d0-fa54-4c36-b567-ebcaa4039af3 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:37.041740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-047958d0-fa54-4c36-b567-ebcaa4039af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:37.127133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 313/638] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:37.127971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047958d0-fa54-4c36-b567-ebcaa4039af3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.144713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d872b0-7cd5-4dbd-8429-16e4c9f5c3af None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.163755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:37.198247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.199816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.200303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.200732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.201305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:37.216516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:37.218554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:37.242998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:37.244194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:37.245285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:37.245285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:37.245285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:37.245285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 326/639] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:37.245655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.262060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047958d0-fa54-4c36-b567-ebcaa4039af3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.308907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.310302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.310864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.312849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.314090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:37.314674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:37.316779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:37.333877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 314/640] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:37.335893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.360469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51712317-a59b-4d79-9d7d-01d79a8cd6d8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.403126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.404198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.404526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.404806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.416666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:37.422658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:37.423735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:37.424625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 327/641] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:37.425315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.454330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:37.458076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef9d68-8445-4a93-8f47-e0f4b22ec7fc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.482363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:37.494938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.495544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.495827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.496105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.496865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:37.497168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:37.498528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:37.510630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 315/642] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:37.511342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.539454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7a640-9ad5-4d12-9b76-c0c4442e0c40 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.574114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.574746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.575031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.575306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.582473 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:37.583906 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:37.595399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:37.596618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 328/643] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:37.597514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.623651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb0bf1-5a59-4ed8-8f5d-cbd0fabb63ef None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.661272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.662002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.662289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.662561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.673847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:37.678861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:37.679783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:37.680737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:37.681474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:37.681546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 316/644] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:37.682103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.704685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11588374-a1cb-4d8f-b623-1bb7aa7153b1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.727032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:37.740494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20322364-1314-448a-8f10-498496d9a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.741106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20322364-1314-448a-8f10-498496d9a252 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.741390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20322364-1314-448a-8f10-498496d9a252 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.741669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20322364-1314-448a-8f10-498496d9a252 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.742337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20322364-1314-448a-8f10-498496d9a252 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:37.742644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20322364-1314-448a-8f10-498496d9a252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:37.744007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20322364-1314-448a-8f10-498496d9a252 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:37.753700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 329/645] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:37.757490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20322364-1314-448a-8f10-498496d9a252 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.790090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c825e6-bef0-43f3-ad8e-d9a171a8330a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.828113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.828768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.829047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.829351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.836470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:37.837954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:37.850118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:37.851083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:37.852023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 317/646] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:37.852654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.872893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20322364-1314-448a-8f10-498496d9a252 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.909371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:37.910074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:37.910425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:37.910810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:37.911685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:37.912163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:37.913991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:37.932417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 330/647] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:37.932417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:37.935991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:37.960485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62c7e-e852-4c46-956b-0bd70915a789 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:37.962056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.002290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.003017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.003372 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.003717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.004541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:38.004992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.007021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.022818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 318/648] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:38.022818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.042689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb071d-2177-4bb9-a8e1-3536ed2a5ccd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.078282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.078920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.079202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.079480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.089995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.091409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:38.106082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:38.107232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:38.113802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:38.113802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:38.113802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:38.113802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 331/649] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:38.113802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.141627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e91d53-2185-443f-ae7f-34c4279bc02f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.171365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.180183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.180896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.181249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.181598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.182792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:38.182792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.184299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.203224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 319/650] 10.222.0.86 () {56 vars in 1137 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:38.204480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.227852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10fa2f-0615-4f09-bfd0-24f2bb829b0c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.232889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.265351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.266143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.266426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.266705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.267431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=748eb93057e245c1b8183dbe0340fa3f) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:38.267744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.269205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.276271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 332/651] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/role_assignments?user.id=748eb93057e245c1b8183dbe0340fa3f&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:38.277343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.324943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc42bc-83d2-4658-b0da-0e42fe3ad7d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.371479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.372190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.372503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.372779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.386537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.388550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:38.409635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:38.410674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:38.411567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:38.411567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:38.411567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:38.416172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 320/652] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:38.417183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.426481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0c953-e46c-423a-9d64-f3a05dfc3755 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.450839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.473822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.474570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.474855 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.479808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.479808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:38.479808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.479808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.493388 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 333/653] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:38.494494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.518820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.550195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538fb8-aa1d-48a5-85a2-7bb3790fb9ef None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.592255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.593900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.594825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.595560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.606775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea17a-4d5e-44a9-8d4d-6560b78f7f39 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.647783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.648427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.648718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.648998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.649760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:38.650069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.651560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.664233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 334/654] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:38.665176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.679816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.681535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.710892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.765244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.776495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c8cb0-f2b1-4301-9e25-13c16ab2e29c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.799516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 321/655] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:38.799516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.819447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.820362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.820823 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.821249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.830190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.831856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:38.844656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:38.845839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 11:10:38.847016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:38.853842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 335/656] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:38.854934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.904134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad5450-9d34-4241-b782-4656c06b3438 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:38.939997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:38.940674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:38.940960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:38.941236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:38.948398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:38.949845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:38.961932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:38.962929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 322/657] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:38.963853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:38.970764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:38.975180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2815d56-e685-4913-b121-09bfa3208b94 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.003948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.008904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2beeb7-2df1-471e-b5c7-5b69d644c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.009542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2beeb7-2df1-471e-b5c7-5b69d644c605 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.009827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2beeb7-2df1-471e-b5c7-5b69d644c605 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.010105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2beeb7-2df1-471e-b5c7-5b69d644c605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.021432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2beeb7-2df1-471e-b5c7-5b69d644c605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:39.022890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2beeb7-2df1-471e-b5c7-5b69d644c605 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-dd2beeb7-2df1-471e-b5c7-5b69d644c605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:39.038693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:39.039624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:39.040665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:39.040665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:39.040665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:39.040665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 336/658] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:39.041484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083341-d7c0-404d-b2f3-24f58fc808a3 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.041484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083341-d7c0-404d-b2f3-24f58fc808a3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.041653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083341-d7c0-404d-b2f3-24f58fc808a3 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.047490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 337/659] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:39.048360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083341-d7c0-404d-b2f3-24f58fc808a3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.081861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e6617-97a8-49de-847e-c39f96410588 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.119111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.120257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.120540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.120846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.121714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:39.122029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:39.123458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:39.141034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 323/660] 10.222.0.86 () {56 vars in 1139 bytes} [Thu Aug 18 11:10:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:39.141849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.157689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083341-d7c0-404d-b2f3-24f58fc808a3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.195118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f9955-c2e2-4c1d-8c67-3fdb46c5548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.195920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9955-c2e2-4c1d-8c67-3fdb46c5548b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.196588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9955-c2e2-4c1d-8c67-3fdb46c5548b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.197006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9955-c2e2-4c1d-8c67-3fdb46c5548b None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.198014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f9955-c2e2-4c1d-8c67-3fdb46c5548b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:39.198482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f9955-c2e2-4c1d-8c67-3fdb46c5548b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:39.200155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f9955-c2e2-4c1d-8c67-3fdb46c5548b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:39.225230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 338/661] 10.222.0.86 () {56 vars in 1137 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:39.226520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73993-c668-4107-ab85-7073c97f2511 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.226808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73993-c668-4107-ab85-7073c97f2511 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.227079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d73993-c668-4107-ab85-7073c97f2511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.245768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-74d73993-c668-4107-ab85-7073c97f2511 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:39.247179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-74d73993-c668-4107-ab85-7073c97f2511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:39.250738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.255969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.264902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b69cf-611a-429c-b0e7-b7d920f78bc3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.301891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.302509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.302797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.303075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.303732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:39.304066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:39.305879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:39.322022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 324/662] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:39.322022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.328488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 339/663] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:39.329308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d73993-c668-4107-ab85-7073c97f2511 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.446638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d73993-c668-4107-ab85-7073c97f2511 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.457709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead79b-92f2-488e-8f8d-5f704b46a031 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.485695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.486372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.486659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.486940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.501277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.509405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.510672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.511154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.511657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.544292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.577214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:39.579188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:39.597678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:39.599827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:39.686514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 340/664] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:39.687396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.719334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 325/665] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:39.720159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.735328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.774787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.795954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1af698-66ad-479a-80e3-4434a90ef285 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.828994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a44a07-6a10-43c1-9eb0-9c350808f58a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:39.831875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.832541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.832824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.833098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.840001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:39.841466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:39.853227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:39.854123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 341/666] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:39.855047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.873426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:39.874407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:39.874906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:39.875386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:39.886481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:39.892036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:39.893001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:39.893839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:39.895794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 326/667] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:39.897396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:39.968803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:39.972577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041b4e-1ab3-4d02-a062-e786385c22a3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.011112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c60ad-cdb5-4a43-a894-b24c28c86e78 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.012110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.012786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.013071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.013352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.024274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.025566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:40.025758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:40.042028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:40.043197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:40.044158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:40.044158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:40.044158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:40.044158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 342/668] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:40.044158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.055207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.056262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.057003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.057275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.069558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.071145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:40.086196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:40.087150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:40.088058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:40.088058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:40.088058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:40.088058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 327/669] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:40.088943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.170527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a939783-435b-4e40-be6e-5f7c46474601 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.199030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322a89-053b-4e5f-b864-f90863688ba0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.211020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.211639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.211922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.212197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.212927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:40.213234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.214669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.233850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 343/670] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:40.233850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.245507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:40.247709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.248380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.248714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.248995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.249673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:40.249982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.251362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.264168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 328/671] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:40.264168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.292519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:40.340839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f74d91-9286-4199-b573-09c0225e7635 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.375490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2b6a8-62a8-4cb6-875b-16c2db96cf6b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.377151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.377762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.378045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.378320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.378965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:40.379289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.380656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.392841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 344/672] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:40.393493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.413151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.414028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.414311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.414585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.415237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:40.415550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.416940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.428602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 329/673] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:40.429563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.463913 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:40.493539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4ef7d-40da-4e98-8329-ce7360e1829d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.514801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:40.527455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3380d4-ac68-45e0-81a2-2033ade0bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.528093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3380d4-ac68-45e0-81a2-2033ade0bc90 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.528414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3380d4-ac68-45e0-81a2-2033ade0bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.528690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3380d4-ac68-45e0-81a2-2033ade0bc90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.529440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3380d4-ac68-45e0-81a2-2033ade0bc90 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=514818f5b23c4234b259e5b47e698a98) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:40.529556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad13faf-fb1f-4d55-af77-b6f8a77c1791 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.529756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3380d4-ac68-45e0-81a2-2033ade0bc90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.531846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3380d4-ac68-45e0-81a2-2033ade0bc90 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.537721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 345/674] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/role_assignments?user.id=514818f5b23c4234b259e5b47e698a98&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:40.539210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706975d1-c901-4fa8-858e-2898e613106b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.539498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706975d1-c901-4fa8-858e-2898e613106b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.539773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706975d1-c901-4fa8-858e-2898e613106b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.544365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 346/675] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:40.546245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706975d1-c901-4fa8-858e-2898e613106b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.568325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.569275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.569627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.569971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.583096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.584776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:40.602825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:40.604002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:40.605118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:40.605118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:40.605118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:40.608917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 330/676] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:40.609942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.669031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706975d1-c901-4fa8-858e-2898e613106b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.711157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd2d82-5daf-45c1-abb9-9fe86a3c5925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.712484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2d82-5daf-45c1-abb9-9fe86a3c5925 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.712836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2d82-5daf-45c1-abb9-9fe86a3c5925 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.713178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd2d82-5daf-45c1-abb9-9fe86a3c5925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.716389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:40.721480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd2d82-5daf-45c1-abb9-9fe86a3c5925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.722923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd2d82-5daf-45c1-abb9-9fe86a3c5925 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.728471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f846e-2bf9-472f-8b92-65a43c11c947 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-02dd2d82-5daf-45c1-abb9-9fe86a3c5925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:40.734859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:40.742031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 347/677] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d69f6-4b0c-4812-b6b5-74e88d00fbb6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.742921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d69f6-4b0c-4812-b6b5-74e88d00fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.743556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d69f6-4b0c-4812-b6b5-74e88d00fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.757349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ca6d69f6-4b0c-4812-b6b5-74e88d00fbb6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:40.759505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ca6d69f6-4b0c-4812-b6b5-74e88d00fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:40.775197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.775856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.776109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.776412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.784287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.785724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.788282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:40.800564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:40.801497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:40.802363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 331/678] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:40.802882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.844250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 348/679] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:40.844250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d69f6-4b0c-4812-b6b5-74e88d00fbb6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.913273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7255-acbb-43b7-b543-f158683aa971 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:40.957047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:40.957666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:40.957948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:40.958225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:40.958880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:40.959184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:40.960601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:40.976959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 332/680] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:40.976959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:40.982691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d69f6-4b0c-4812-b6b5-74e88d00fbb6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.016592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.023714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.024532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.024967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.025377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.026472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:41.027007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.028604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.039491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.047993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 349/681] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:41.049125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.084260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5238b4-6a18-4c08-94ca-354a8ad0421f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.126753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.127613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.128174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.129383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.130307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:41.130617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.132233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.148146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 333/682] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:41.148146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.169799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9fd44-14d4-4b2a-8249-de2e5e4ef500 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.209978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.210605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.210887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.211158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.219588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.221052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:41.235160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:41.236457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:41.237484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 350/683] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:41.238212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.266959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119fb60-1989-4fd6-90f5-2fedeb374f08 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.285731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.289576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.303204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.309432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.309432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.309432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.309432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=0bc29638c1994ab09ea1b1f7c7f247ae) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:41.309432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.309432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.313283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 334/684] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/role_assignments?user.id=0bc29638c1994ab09ea1b1f7c7f247ae&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:41.314223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.350182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771149e0-356b-4562-a6a0-b7508576b78e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.397338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.398281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.398707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.399147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.412161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:41.418782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:41.424563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 351/685] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:41.425487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.468233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c5e81-7235-4d7f-bd1d-fdb22ecf2585 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.507554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.508974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.508974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.508974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.509750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=bfd4d0f2f95b4861888c33b0c66c602b) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:41.510134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.511635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.519174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 335/686] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/role_assignments?user.id=bfd4d0f2f95b4861888c33b0c66c602b&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:41.520202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.559131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc831b6c-49f6-4210-ad90-5dc7bdd99ebe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.570582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.585189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.611009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.611802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.612193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.613059 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.613964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:41.614384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.617115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.642885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 352/687] 10.222.0.86 () {56 vars in 1135 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:41.650085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.661661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030954d5-51bb-4617-ae51-d105acb0ec33 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.706513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.707061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.707341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.707617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.708314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:41.708624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.710192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.721772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 336/688] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:41.727186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:41.774488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64448b-c1fe-49a9-a4d8-a9478d4b2eba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.823054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.824544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.824834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.825114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.865783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc7dc9-cf84-4ef3-9a99-1a2f9443d400 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:41.870860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.880146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:41.913218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:41.914488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:41.914849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:41.914973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.915210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:41.916807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.934169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:41.935624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:41.957707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:41.958673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:41.959587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:41.959587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:41.959587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:41.959587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 337/689] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:41.965173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.034999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 353/690] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 11:10:42.040992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.094684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78265-3707-4f02-985f-73cf7ffd82ab None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:42.117410 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:42.149808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:42.150436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.150732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.152261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.152261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:42.152261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:42.160752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:42.183121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eb06c-179d-4426-96f5-b4a3cda99ff7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:42.190817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 338/691] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:42.201226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.224867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:42.225432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.225715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.232300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.243282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:42.255445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:42.258329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:42.288046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:42.289398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:42.290358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:42.290358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:42.290358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:42.290358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 354/692] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:42.296022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.415934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fc8e2-7b23-44c5-ae24-811c2e371dd0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:42.439195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:42.454494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cbd3d-bfbc-4262-a8cc-efd29bed3d84 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:42.460513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:42.461127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.461407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.461689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.462333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:42.462632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:42.464545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:42.478396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 355/693] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:42.484608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.568964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28793aa3-dac9-43cc-8024-df615349e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:42.569631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28793aa3-dac9-43cc-8024-df615349e94c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.569920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28793aa3-dac9-43cc-8024-df615349e94c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.570203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28793aa3-dac9-43cc-8024-df615349e94c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.593366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28793aa3-dac9-43cc-8024-df615349e94c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:42.594694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b6b0-c407-4693-a3f2-3e94b8d5a2c6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:42.594895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28793aa3-dac9-43cc-8024-df615349e94c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-28793aa3-dac9-43cc-8024-df615349e94c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:42.625980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:42.628199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:42.630723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 339/694] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:10:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:42.635796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cf1e8-d9f2-4533-a153-61e36e95de89 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.635796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cf1e8-d9f2-4533-a153-61e36e95de89 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.635796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cf1e8-d9f2-4533-a153-61e36e95de89 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.635796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 340/695] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:10:42.638135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ed5ff-9b71-402a-830a-1fb7054990fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:42.638135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed5ff-9b71-402a-830a-1fb7054990fb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.638135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed5ff-9b71-402a-830a-1fb7054990fb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.638135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed5ff-9b71-402a-830a-1fb7054990fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.638793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cf1e8-d9f2-4533-a153-61e36e95de89 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.646142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ed5ff-9b71-402a-830a-1fb7054990fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:42.647678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ed5ff-9b71-402a-830a-1fb7054990fb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-dd9ed5ff-9b71-402a-830a-1fb7054990fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:42.660808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:42.662604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 356/696] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed675a7-1e63-4240-9ca5-92108d827c2d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.665004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed675a7-1e63-4240-9ca5-92108d827c2d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.666399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed675a7-1e63-4240-9ca5-92108d827c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.691335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9ed675a7-1e63-4240-9ca5-92108d827c2d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:42.692939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9ed675a7-1e63-4240-9ca5-92108d827c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:42.728598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:42.747720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:42.773946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cf1e8-d9f2-4533-a153-61e36e95de89 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:42.776860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 357/697] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:42.777249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed675a7-1e63-4240-9ca5-92108d827c2d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.838804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:42.839433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:42.839712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:42.839991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:42.840752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:42.841056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:42.843136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:42.885159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 341/698] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:10:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:42.891273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:42.975582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed675a7-1e63-4240-9ca5-92108d827c2d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.053831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.055244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.058191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.058191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.058191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:43.058191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.059163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.074803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 358/699] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:43.084243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:43.101288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3edca-a5be-4a71-a38f-c6de24ff6a52 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.122078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:43.145070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.145682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.145962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.146235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.154566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:43.226032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.227696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.240290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086797-896f-47ee-b235-745d5b179f95 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.278672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.279292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.279578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.279888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.280656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=3fecc15bbe7f4a71ac8821ea057153b2) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:43.281232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.283216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.291084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 359/700] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:43 2022] GET /identity/v3/role_assignments?user.id=3fecc15bbe7f4a71ac8821ea057153b2&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:43.291916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:43.393833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 342/701] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 11:10:43.407733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:43.408159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:43.419721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a8766-066c-4317-b512-e84da0fc51f5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.459597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.460284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.460576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.460851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.473278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.474748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:43.491018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:43.492033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:43.492974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:43.492974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:43.492974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:43.492974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 360/702] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:43.494989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:43.499816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:43.584333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6b25-b0cb-4652-a13d-73c9a3e6350f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.628311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.629240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.629525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.629806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.636671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8256a-fb28-4c7a-a3f4-0390bf22336f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.647310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.649427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:43.671839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:43.674434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:43.676895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:43.676895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:43.676895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:43.676895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 343/703] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:43.677417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.677417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.677417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.677864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.680258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:43.680258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.680476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:43.680555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.696732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 361/704] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:43.702955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:43.705912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:43.803425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:43.815937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9871d2-d2ac-427f-b6bf-2a85de2b314e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.835903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eb77b-9c4a-4242-9954-951ccc29f75a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:43.851669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486035f-89b1-4cd0-be68-bf471fd502c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.852591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486035f-89b1-4cd0-be68-bf471fd502c5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.853030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486035f-89b1-4cd0-be68-bf471fd502c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.853490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486035f-89b1-4cd0-be68-bf471fd502c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.854317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486035f-89b1-4cd0-be68-bf471fd502c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:43.854779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486035f-89b1-4cd0-be68-bf471fd502c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.856351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486035f-89b1-4cd0-be68-bf471fd502c5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.869682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 344/705] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:43.876326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f1eb-4484-4426-a108-488df743b5c8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.884272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f1eb-4484-4426-a108-488df743b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.884401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a5f54-26a8-43ca-a54c-3429dfaf84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:43.884511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f1eb-4484-4426-a108-488df743b5c8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.884598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5f54-26a8-43ca-a54c-3429dfaf84a8 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.884598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5f54-26a8-43ca-a54c-3429dfaf84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.884598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5f54-26a8-43ca-a54c-3429dfaf84a8 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.884856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 345/706] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:43.884947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a5f54-26a8-43ca-a54c-3429dfaf84a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:43.885047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f1eb-4484-4426-a108-488df743b5c8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:43.885140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a5f54-26a8-43ca-a54c-3429dfaf84a8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:43.984400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 362/707] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:10:43 2022] POST /identity/v3/users => generated 254 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:10:43.986230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb96e-2c72-4fb0-9452-74e030aaf901 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:43.986701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb96e-2c72-4fb0-9452-74e030aaf901 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:43.987129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb96e-2c72-4fb0-9452-74e030aaf901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:43.999756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f1eb-4484-4426-a108-488df743b5c8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:44.008970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-345bb96e-2c72-4fb0-9452-74e030aaf901 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:44.010497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-345bb96e-2c72-4fb0-9452-74e030aaf901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:44.042984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a876a32-236b-485f-befa-387eb1667028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:44.043786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876a32-236b-485f-befa-387eb1667028 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.044169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876a32-236b-485f-befa-387eb1667028 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.044573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a876a32-236b-485f-befa-387eb1667028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.053004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a876a32-236b-485f-befa-387eb1667028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:44.055815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a876a32-236b-485f-befa-387eb1667028 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8a876a32-236b-485f-befa-387eb1667028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:44.072283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:44.073318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:44.074206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:44.076364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 346/708] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:44.078722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df33a8-4686-4cdf-b747-f82acbdc495c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.079250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df33a8-4686-4cdf-b747-f82acbdc495c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.080648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df33a8-4686-4cdf-b747-f82acbdc495c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.082405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 347/709] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:44.083225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df33a8-4686-4cdf-b747-f82acbdc495c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:44.088344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:44.104742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:44.106596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 363/710] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:44.108162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d9125-b10d-422f-a362-fface8472e62 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.108823 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d9125-b10d-422f-a362-fface8472e62 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.109318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d9125-b10d-422f-a362-fface8472e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.129313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-580d9125-b10d-422f-a362-fface8472e62 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:44.131267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-580d9125-b10d-422f-a362-fface8472e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:44.244357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 364/711] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:44.244765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df33a8-4686-4cdf-b747-f82acbdc495c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:44.293034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:44.294111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.294608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.295126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.296095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:44.296631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:44.298411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:44.312574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 348/712] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:44.320761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d9125-b10d-422f-a362-fface8472e62 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:44.409051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:44.444270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d9125-b10d-422f-a362-fface8472e62 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:44.469814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:44.493561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:44.495047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.495370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.495747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.496935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=748eb93057e245c1b8183dbe0340fa3f) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:44.497352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:44.498583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:44.499949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:44.510576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 365/713] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:44 2022] GET /identity/v3/role_assignments?user.id=748eb93057e245c1b8183dbe0340fa3f&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:44.543024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:44.561879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217779a-8ce3-43d0-8dde-a378ad5a3d7d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:44.637817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:44.638480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.638765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.639106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.640413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:44.641841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:44.666346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:44.667673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:44.668877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 349/714] 10.222.0.86 () {56 vars in 1129 bytes} [Thu Aug 18 11:10:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:44.674277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:44.701232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c288fa5-1b98-402f-bc89-d60faa0d038d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:44.749193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:44.750271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.750713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.751129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] PATH_INFO: `/v3/services/network` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.751861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:44.753417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:44.853110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c8664-abde-4fc6-a191-2bb823593611 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:44.892779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:44.895225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:44.895225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:44.895225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:44.895225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:44.895225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:44.906982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:44.908271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:44.909325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:44.910195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:44.911869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 366/715] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:44 2022] GET /identity/v3/services/network => generated 88 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:44.916699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:44.917909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:44.919163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 350/716] 10.222.0.86 () {56 vars in 1124 bytes} [Thu Aug 18 11:10:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:44.925178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:45.004632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:45.100361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f543f-cc01-44f5-b0b8-cb496d6f7300 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:45.118035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390eedc-4bb6-4c37-a449-c3a3c95af6a7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:45.165923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:45.166549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:45.166836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:45.167112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:45.167756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] RBAC: Adding query filter params (name=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:45.168061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:45.169649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:45.183987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f8d45-3c12-4cf4-83be-ffcfd17799a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:45.188358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 367/717] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:10:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:45.188913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8d45-3c12-4cf4-83be-ffcfd17799a0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:45.189206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8d45-3c12-4cf4-83be-ffcfd17799a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:45.189490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f8d45-3c12-4cf4-83be-ffcfd17799a0 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:45.190142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f8d45-3c12-4cf4-83be-ffcfd17799a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:45.190450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f8d45-3c12-4cf4-83be-ffcfd17799a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:45.191837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f8d45-3c12-4cf4-83be-ffcfd17799a0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:45.195532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:45.199589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 351/718] 10.222.0.86 () {56 vars in 1124 bytes} [Thu Aug 18 11:10:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:45.360496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cdf8a-99f6-49b7-a7e0-8d3efb531a6d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:45.380429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:45.408336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d35f2a-938c-427e-8294-4b56e028352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:45.408950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35f2a-938c-427e-8294-4b56e028352d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:45.415649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35f2a-938c-427e-8294-4b56e028352d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:45.415649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d35f2a-938c-427e-8294-4b56e028352d None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:45.415649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35f2a-938c-427e-8294-4b56e028352d None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:45.415649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35f2a-938c-427e-8294-4b56e028352d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:45.415649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d35f2a-938c-427e-8294-4b56e028352d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:45.419449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 368/719] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:10:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:45.801897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb476-0976-4d1f-8044-3ec984fc7f3b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:45.802409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb476-0976-4d1f-8044-3ec984fc7f3b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:45.802496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb476-0976-4d1f-8044-3ec984fc7f3b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:45.804079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 352/720] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:45.809378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19694-24e0-4a4f-85b0-ce530459e808 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:45.809670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19694-24e0-4a4f-85b0-ce530459e808 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:45.809948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19694-24e0-4a4f-85b0-ce530459e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:45.829118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-54a19694-24e0-4a4f-85b0-ce530459e808 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:45.830417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-54a19694-24e0-4a4f-85b0-ce530459e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:45.904325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 369/721] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:46.325462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb476-0976-4d1f-8044-3ec984fc7f3b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:46.403605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:46.454686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb476-0976-4d1f-8044-3ec984fc7f3b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:46.494533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d9854-b637-434c-a448-0a88b8f2c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:46.495114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d9854-b637-434c-a448-0a88b8f2c997 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:46.495384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d9854-b637-434c-a448-0a88b8f2c997 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:46.495664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d9854-b637-434c-a448-0a88b8f2c997 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:46.511699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d9854-b637-434c-a448-0a88b8f2c997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ab3d9854-b637-434c-a448-0a88b8f2c997 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:46.517865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:46.518829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:46.519658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 353/722] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:46.524987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19694-24e0-4a4f-85b0-ce530459e808 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:46.698987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19694-24e0-4a4f-85b0-ce530459e808 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:46.701834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:46.743722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:46.744373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:46.744712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:46.744934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:46.745616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:46.745922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:46.747285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:46.761116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 370/723] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:46.761292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ac33-c4b7-46c3-8fed-d75e61ed4103 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:46.761511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ac33-c4b7-46c3-8fed-d75e61ed4103 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:46.761774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ac33-c4b7-46c3-8fed-d75e61ed4103 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:46.762032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:46.763674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 354/724] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:46.773635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4715148-9d16-4978-ab8d-c75437cf40c8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:46.773928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4715148-9d16-4978-ab8d-c75437cf40c8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:46.774211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4715148-9d16-4978-ab8d-c75437cf40c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:46.815175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b4715148-9d16-4978-ab8d-c75437cf40c8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:46.816495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b4715148-9d16-4978-ab8d-c75437cf40c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:46.910762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458437a8-8769-48bd-9673-376e12cff3d5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:46.936725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 355/725] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:46.938053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca4076-e67a-4b79-b035-824fd367c455 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:46.938341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca4076-e67a-4b79-b035-824fd367c455 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:46.938641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca4076-e67a-4b79-b035-824fd367c455 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:46.940242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 356/726] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:46.945249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a1d6-94ea-4339-9329-68fe210e854c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:46.945758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a1d6-94ea-4339-9329-68fe210e854c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:46.946237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1a1d6-94ea-4339-9329-68fe210e854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:46.958749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:46.959390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:46.959673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:46.959951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:46.967488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d7d1a1d6-94ea-4339-9329-68fe210e854c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:46.969008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d7d1a1d6-94ea-4339-9329-68fe210e854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:46.973450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:46.974892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:46.995186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:46.996145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:47.002659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:47.002659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:47.002659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:47.002659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 371/727] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:47.004405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.043688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:47.050485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:47.104261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 357/728] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:47.155232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a2132-7d26-4326-bd19-6793184e827f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.210405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.211026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.211304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.211573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.212241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:47.212551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:47.213911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:47.238449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 372/729] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:47.244098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a1d6-94ea-4339-9329-68fe210e854c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.298210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.401708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:47.444606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60673a61-20e4-476e-81a0-ba2b7a39e14b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.450921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1a1d6-94ea-4339-9329-68fe210e854c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.481617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.482255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.482559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.482839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.493518 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:47.494804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.495439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.495719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.495992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:47.498949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:47.499859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 373/730] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:47.501133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.503957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:47.506276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:47.521784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:47.523829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 358/731] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:47.525056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.583032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:47.611945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42a03-05e5-40d6-b338-6f005ed6ba15 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.648506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.648968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80ba7-b864-44cd-96ca-f8087b4eac67 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.649221 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.649505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.649784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.657684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:47.662070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:47.667101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:47.668073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 374/732] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:47.676052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.693305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.694258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.694554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.694836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.695519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:47.695848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:47.697236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:47.712818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 359/733] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:47.712818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.782060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93265a8d-9323-448c-b712-d583466586d0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.819087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f3591-7e3e-49d4-b611-62a87a31fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.820049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3591-7e3e-49d4-b611-62a87a31fe9f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.820552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3591-7e3e-49d4-b611-62a87a31fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.821011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3591-7e3e-49d4-b611-62a87a31fe9f None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.822284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f3591-7e3e-49d4-b611-62a87a31fe9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:47.822724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766c16-41d8-4ca0-9a09-219eb98f392d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.823173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f3591-7e3e-49d4-b611-62a87a31fe9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:47.825363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f3591-7e3e-49d4-b611-62a87a31fe9f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:47.826059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:47.844189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 375/734] 10.222.0.86 () {56 vars in 1135 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:47.845825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbff25-379e-4a74-b8f1-f3944095a664 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.846116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbff25-379e-4a74-b8f1-f3944095a664 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.846395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbff25-379e-4a74-b8f1-f3944095a664 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.847582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 376/735] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:47.848394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbff25-379e-4a74-b8f1-f3944095a664 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.863372 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24eecf-b1ac-4fdf-8c5c-c892dc75660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.863986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24eecf-b1ac-4fdf-8c5c-c892dc75660e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.864295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24eecf-b1ac-4fdf-8c5c-c892dc75660e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.864569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24eecf-b1ac-4fdf-8c5c-c892dc75660e None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.871828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24eecf-b1ac-4fdf-8c5c-c892dc75660e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:47.871828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24eecf-b1ac-4fdf-8c5c-c892dc75660e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:47.871828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24eecf-b1ac-4fdf-8c5c-c892dc75660e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:47.875712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 360/736] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:47.876932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8851ff0-6065-4cfb-911d-102543d6a3d8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.877183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8851ff0-6065-4cfb-911d-102543d6a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.877454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8851ff0-6065-4cfb-911d-102543d6a3d8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.878783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 361/737] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:47.879304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8851ff0-6065-4cfb-911d-102543d6a3d8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:47.910848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:47.955527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbff25-379e-4a74-b8f1-f3944095a664 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:47.987945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6ebe1-98c0-4200-bf9e-567d4e58fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:47.988599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6ebe1-98c0-4200-bf9e-567d4e58fba4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:47.988878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6ebe1-98c0-4200-bf9e-567d4e58fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:47.989148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6ebe1-98c0-4200-bf9e-567d4e58fba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:47.997533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8851ff0-6065-4cfb-911d-102543d6a3d8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.000311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6ebe1-98c0-4200-bf9e-567d4e58fba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.001739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6ebe1-98c0-4200-bf9e-567d4e58fba4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d5d6ebe1-98c0-4200-bf9e-567d4e58fba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:48.015550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:48.016698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:48.017704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:48.017704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:48.017704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:48.021469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 377/738] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:48.022624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353dfd6-9eed-48db-a061-f85c362e488b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.022913 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353dfd6-9eed-48db-a061-f85c362e488b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.023191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353dfd6-9eed-48db-a061-f85c362e488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.031125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad280-6888-4baf-9cca-2102818ae0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.031731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad280-6888-4baf-9cca-2102818ae0fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.032043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad280-6888-4baf-9cca-2102818ae0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.032349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad280-6888-4baf-9cca-2102818ae0fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.041996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6353dfd6-9eed-48db-a061-f85c362e488b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:48.043179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6353dfd6-9eed-48db-a061-f85c362e488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:48.068782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.100938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad280-6888-4baf-9cca-2102818ae0fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.102458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad280-6888-4baf-9cca-2102818ae0fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.109448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 378/739] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:48.110267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353dfd6-9eed-48db-a061-f85c362e488b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.150249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.212890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 362/740] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 11:10:48.213578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353dfd6-9eed-48db-a061-f85c362e488b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.218984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03df3d-2eda-4b25-8901-50bc80eec985 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.219273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03df3d-2eda-4b25-8901-50bc80eec985 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.219545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03df3d-2eda-4b25-8901-50bc80eec985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.238152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1a03df3d-2eda-4b25-8901-50bc80eec985 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:48.239325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a03df3d-2eda-4b25-8901-50bc80eec985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:48.255400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.256446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.256723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.256984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.267158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.268653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:48.283721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:48.284716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:48.285652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:48.285652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:48.285652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:48.285652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 379/741] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:48.285652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.307800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.315542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 363/742] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 11:10:48.320995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03df3d-2eda-4b25-8901-50bc80eec985 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.384847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.394364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6133de-ed13-4095-bb09-4d8cb6b66afb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.432319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.432933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.433216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.433493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.434140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:48.434447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.436377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.441944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03df3d-2eda-4b25-8901-50bc80eec985 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.448153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 380/743] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:48.448987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.481573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.482359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.482752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.483038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.493069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.494519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:48.509488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:48.510448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:48.511334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:48.511334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:48.511334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:48.511334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 364/744] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:48.511334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.562355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.562795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93566664-1287-4d80-864a-16b1a9eec067 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.599262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.599916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.600155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.600464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.601117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:48.601426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.602782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.614616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 381/745] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:48.615417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.615583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ee933-a78c-4718-834e-ab9d7204c58a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.630744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.652076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.652652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.652937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.653222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.653896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.655439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.719733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be05f98-be80-4063-b46b-5a1d7b7733b6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.746731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 365/746] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:10:48 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:48.747987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.767658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.768615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.769038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.769513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.778765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.780619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:48.793942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:48.795714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:10:48.797019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:48.799420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 382/747] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:10:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:48.800511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.874644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c0a7-c7d9-45a7-aeef-2fb68ce46fc8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.881686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.886334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:48.916494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.917053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.917368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.917671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.918355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:48.918691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.920429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:48.921980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebd07f-ef14-410f-890e-b1c47d921266 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:48.936683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 366/748] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:48.942427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:48.964596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:48.965635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:48.966130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:48.966582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:48.968194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:48.970668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.040243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 383/749] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:10:48 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:49.040243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.049573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4189db9-17f4-48af-b8a8-5cf99839182f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.109399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.110452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.110905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.111359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.121657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.123617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:49.137780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:49.138919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 367/750] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:10:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:49.140911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.176124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:49.196514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d8a69-64ee-47ca-84f4-04081b3fe44e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.247549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:49.261108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.261829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.262851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.262851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.263121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:49.263434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.266414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.272987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da3444-008b-4902-9a09-1786743f1e90 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.293730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 384/751] 10.222.0.86 () {56 vars in 1149 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:49.296108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.319534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.320777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.321302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.321786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.330227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.332367 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:49.346024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:49.346956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:49.347831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:49.350336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 368/752] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:49.356226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.407844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f17f4b-76b9-470d-868c-a4e186df0d0d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.445144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.445684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.445968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.446265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.446990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:49.447297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.448842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.458549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:49.476023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 385/753] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:49.476023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.482363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fd9fa-484f-4246-bc54-b21ef9375832 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.522131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.523126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.523557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.523976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.524840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:49.587645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b2f1b-2b1d-464f-a155-901b7abd2438 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.604244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.606076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.626603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.628053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.628456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.628838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.629688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:49.630121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.632653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.653130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 386/754] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:49.653130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.707371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:49.730619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 369/755] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:10:49.731656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.789476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cce91-b8e0-4684-a5aa-dcb9ae8bfa9a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.791884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:49.829610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.830072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.830359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.830634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.846378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.847868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:49.865246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:49.866253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:49.867220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:49.867220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:49.867220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:49.869685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d64346-cb2f-4dd3-8a49-113057f8f8a4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:49.871158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 387/756] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:49.884918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.914985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:49.915765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:49.916097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:49.916518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:49.917462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=3fecc15bbe7f4a71ac8821ea057153b2) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:49.917878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:49.919455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:49.926597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 370/757] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/role_assignments?user.id=3fecc15bbe7f4a71ac8821ea057153b2&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:49.927538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:49.997676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:50.010353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad83f-fd08-461c-9a54-56293b9e621a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.050424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.051431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.051891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.052417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.055387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d85467-da3f-4d17-8cd8-a8d057b6bb55 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.065905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.067772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:50.084980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:50.085994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:50.086889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:50.086889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:50.086889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:50.089124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 388/758] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:50.097504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:50.098180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.098989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.099283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.099561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.100242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:50.100582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.101973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.115308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 371/759] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:50.116583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:50.120730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:50.234686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf17dd-14c4-41e0-9f34-ddf45ddd3d5b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.249929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:50.273740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.274389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.274672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.274955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.284001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.286700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.290531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258f966-c09b-45fc-a235-a040501a3d6b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:50.301109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:50.302857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:50.304672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 372/760] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:50.309196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:50.348712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.349336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.349677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.349961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.350623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:50.350934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.352347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.374650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 389/761] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:50.380447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:50.421582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0d7e1-c1cc-47f8-ad38-dc0b6699212b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.457030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.457653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.457938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.458216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.458927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:50.459237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.461302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.475794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 373/762] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:50.481857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:50.513484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:50.514905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:50.589475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2bfa5-1c6d-4987-b8fb-3f6dd0958097 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.612433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158977b-6e9a-4b35-8b4f-3da196ed9f7b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.636706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.637376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.637660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.637938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/748eb93057e245c1b8183dbe0340fa3f/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.641286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=748eb93057e245c1b8183dbe0340fa3f, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.642735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.665206 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.667348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.667348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.667348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.674434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.676065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:50.688011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:50.690090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:50.692171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:50.700235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 390/763] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:50.700235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:50.740837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 374/764] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:50 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/748eb93057e245c1b8183dbe0340fa3f/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:10:50.825870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd25a4-afe3-49ff-98a3-407b4b3ae7da None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:50.865668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:50.879441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa19c6a-304e-4087-a7e8-6cff9bc13666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:50.880067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa19c6a-304e-4087-a7e8-6cff9bc13666 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.880380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa19c6a-304e-4087-a7e8-6cff9bc13666 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.880696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa19c6a-304e-4087-a7e8-6cff9bc13666 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.881556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa19c6a-304e-4087-a7e8-6cff9bc13666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:50.881988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa19c6a-304e-4087-a7e8-6cff9bc13666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:50.884084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa19c6a-304e-4087-a7e8-6cff9bc13666 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:50.905990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 391/765] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:50.912114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:50.944329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4386c4-d603-47a7-8592-5fadca0b1488 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.944661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4386c4-d603-47a7-8592-5fadca0b1488 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.944879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4386c4-d603-47a7-8592-5fadca0b1488 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.946623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 392/766] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:10:50.952085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28ef3-f5f7-492d-9592-20c649bbe51d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:50.952441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28ef3-f5f7-492d-9592-20c649bbe51d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:50.952669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28ef3-f5f7-492d-9592-20c649bbe51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:50.972956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-03b28ef3-f5f7-492d-9592-20c649bbe51d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:50.974150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-03b28ef3-f5f7-492d-9592-20c649bbe51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:51.035122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:51.051720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d92d20-fc45-4867-b696-af67b6a751f6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:51.053958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 393/767] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:10:51.093027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f90c3-07cb-4fbd-84cd-f7701365f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:51.093616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f90c3-07cb-4fbd-84cd-f7701365f0be None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:51.093899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f90c3-07cb-4fbd-84cd-f7701365f0be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:51.094176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f90c3-07cb-4fbd-84cd-f7701365f0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:51.095016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f90c3-07cb-4fbd-84cd-f7701365f0be None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=5409b17aa2224f0fa60de95d5fc2e892) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:51.095333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f90c3-07cb-4fbd-84cd-f7701365f0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:51.096960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f90c3-07cb-4fbd-84cd-f7701365f0be None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:51.103065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 375/768] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:50 2022] GET /identity/v3/role_assignments?user.id=5409b17aa2224f0fa60de95d5fc2e892&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:51.351680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b28ef3-f5f7-492d-9592-20c649bbe51d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:51.451469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30704d5-745d-4381-a9a9-3f8364c756e5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:51.451891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30704d5-745d-4381-a9a9-3f8364c756e5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:51.452238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30704d5-745d-4381-a9a9-3f8364c756e5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:51.456299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 376/769] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:51.457667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b28ef3-f5f7-492d-9592-20c649bbe51d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:51.461957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c03f6-d481-4e48-813b-42b500954590 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:51.462192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c03f6-d481-4e48-813b-42b500954590 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:51.462442 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c03f6-d481-4e48-813b-42b500954590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:51.481212 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-445c03f6-d481-4e48-813b-42b500954590 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:51.483044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-445c03f6-d481-4e48-813b-42b500954590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:51.486081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:51.511525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:51.512280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:51.512566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:51.512843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:51.513462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:51.515163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:51.539362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:51.541750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:51.543678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 394/770] 10.222.0.86 () {56 vars in 1129 bytes} [Thu Aug 18 11:10:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:51.552305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:51.611018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 377/771] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:10:51.723796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91621d81-2444-412c-b735-c8992c36c690 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:51.758591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:51.759268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:51.759555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:51.759831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:51.760553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:51.760864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:51.762304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:51.767930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 395/772] 10.222.0.86 () {56 vars in 1124 bytes} [Thu Aug 18 11:10:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:51.773471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c03f6-d481-4e48-813b-42b500954590 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:51.892331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:51.913995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:51.915027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c03f6-d481-4e48-813b-42b500954590 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:51.967990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:51.969466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:51.969466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:51.969790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:51.971459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:51.971767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:51.973176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:51.985385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 378/773] 10.222.0.86 () {56 vars in 1124 bytes} [Thu Aug 18 11:10:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:51.991975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:52.008716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:52.109320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fdb2-411b-4062-b4b7-edec4559ff8f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:52.171412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:52.171968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.172277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.173200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] PATH_INFO: `/v3/services/network` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.175091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:52.176479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:52.180421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a96ce-87a6-48a6-9c7e-83c9eb366a45 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:52.195464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:52.197714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:52.199581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 396/774] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:51 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:52.207546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:52.251194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:52.252413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.252702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.252978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.253698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] RBAC: Adding query filter params (interface=public, service_id=0dae457f9a8e499ca3270da8f701dd0c, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:52.254012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:52.258200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:52.278145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 379/775] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:10:51 2022] GET /identity/v3/endpoints?service_id=0dae457f9a8e499ca3270da8f701dd0c&interface=public®ion_id=RegionOne => generated 194 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:52.281009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:52.316348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:52.368514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032f49f-7ce8-48ae-8591-f49951cb4700 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:52.376042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:52.407228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:52.407863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.408153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.409433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.410704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] RBAC: Adding query filter params (name=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:52.411031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:52.412503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:52.422668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 397/776] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:10:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:52.429189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:52.460541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707342-d84f-454d-8a26-aab6d1664493 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:52.512273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cc5ec-9248-4d5c-b9b1-943931b8c3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:52.512929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc5ec-9248-4d5c-b9b1-943931b8c3ac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.513278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc5ec-9248-4d5c-b9b1-943931b8c3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.513614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc5ec-9248-4d5c-b9b1-943931b8c3ac None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.514244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cc5ec-9248-4d5c-b9b1-943931b8c3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:52.515636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cc5ec-9248-4d5c-b9b1-943931b8c3ac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:52.521445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 380/777] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:10:52 2022] GET /identity/v3/services => generated 772 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:52.525043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07ef4-e041-4a03-894f-be5b2a17c004 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.525399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07ef4-e041-4a03-894f-be5b2a17c004 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.525743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a07ef4-e041-4a03-894f-be5b2a17c004 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.527390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 381/778] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:10:52.533672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9639f4-f739-4010-8d63-51cf9219aa49 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.533964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9639f4-f739-4010-8d63-51cf9219aa49 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.534242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9639f4-f739-4010-8d63-51cf9219aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.573200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7b9639f4-f739-4010-8d63-51cf9219aa49 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:52.574447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7b9639f4-f739-4010-8d63-51cf9219aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:52.645284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301c708-3c70-4dac-aab2-564ecc22d53d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:52.684125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:52.684709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.684982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.685263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.686019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:52.686326 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:52.687704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:52.693955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 398/779] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:10:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:52.700554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:52.725211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 382/780] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:10:52.740907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:52.807343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3cb9d-6764-47a3-8b51-35c5a7b13b4b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:52.848384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:52.849005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:52.849286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:52.849752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:52.850465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] RBAC: Adding query filter params (interface=public, service_id=98834c2f39914dc4a58e0c98bd5ab01c, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:52.850779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:52.852133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:52.860515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 399/781] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:10:52 2022] GET /identity/v3/endpoints?service_id=98834c2f39914dc4a58e0c98bd5ab01c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:52.865954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9639f4-f739-4010-8d63-51cf9219aa49 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:52.878556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:52.972129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9639f4-f739-4010-8d63-51cf9219aa49 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:53.007719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:53.008365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.008647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.008924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.009534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:53.010904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:53.017011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 383/782] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:10:52 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:53.080756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:53.204578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:53.209930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109d9b9-da15-4456-84f2-3c66a75558b2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:53.251385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14f38-e145-425d-9db4-93012df1b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:53.252070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14f38-e145-425d-9db4-93012df1b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.252287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14f38-e145-425d-9db4-93012df1b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.252545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14f38-e145-425d-9db4-93012df1b0d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.265188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14f38-e145-425d-9db4-93012df1b0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-acd14f38-e145-425d-9db4-93012df1b0d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:53.269875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:53.270784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:53.272253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 400/783] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:53.276784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:53.346645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:53.381303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20f739-7730-48bf-b76b-33fb4f0373d4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:53.398630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c007-1256-4bd5-8031-2a53b1258122 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.398932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c007-1256-4bd5-8031-2a53b1258122 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.399328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c007-1256-4bd5-8031-2a53b1258122 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.401338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 401/784] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:10:53.407541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f277f19-010d-4b08-bc0f-f1d75b4b03f4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.407820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f277f19-010d-4b08-bc0f-f1d75b4b03f4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.408091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f277f19-010d-4b08-bc0f-f1d75b4b03f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.429866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4f277f19-010d-4b08-bc0f-f1d75b4b03f4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:53.431048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4f277f19-010d-4b08-bc0f-f1d75b4b03f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:53.440985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:53.441925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.441925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.442183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.442818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:53.443123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:53.444508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:53.460895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 384/785] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:10:53.466378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:53.553717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 402/786] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:10:53.560254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b58ec6-25b7-4ef4-a73a-fac039ed0fe4 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.561113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b58ec6-25b7-4ef4-a73a-fac039ed0fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.561387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b58ec6-25b7-4ef4-a73a-fac039ed0fe4 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.566343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 403/787] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:53.581607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a6c22-5f54-47ac-bf02-a540e1815d98 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.581890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a6c22-5f54-47ac-bf02-a540e1815d98 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.582163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a6c22-5f54-47ac-bf02-a540e1815d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.627240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585662ab-0ddd-4876-b513-71954d25c5bb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:53.629219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2c8a6c22-5f54-47ac-bf02-a540e1815d98 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:53.630849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2c8a6c22-5f54-47ac-bf02-a540e1815d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:53.658754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:53.665744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:53.666673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.667171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.667712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.680022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:53.682023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:53.698748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:53.699723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:53.700665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:53.700665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:53.700665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:53.703065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 385/788] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:53.708238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:53.737926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 404/789] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:10:53.831791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98968ab-90de-430c-94cc-eac55194557d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:53.872701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:53.873468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:53.873751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:53.874026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:53.874679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:53.874979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:53.876426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:53.897548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 386/790] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:53.902989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a6c22-5f54-47ac-bf02-a540e1815d98 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:53.930491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:53.935786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.012424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.085417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a6c22-5f54-47ac-bf02-a540e1815d98 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.108031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6221de-89ad-44d9-a5eb-3713b48d4739 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.128978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.129621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.129900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.130175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.139972 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.142088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.147209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.147838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.148122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.148425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:54.155056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:54.155988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:54.157669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 405/791] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:54.158271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.160102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:54.166627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:54.167568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:54.168928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 387/792] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:54.170097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.266611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.286898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da0ff8-eff7-4495-b736-18895175185f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.306579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88279-9d13-45bc-97a1-00ef61d0a87b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.309143 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.327095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.327883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.328162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.328476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.340033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:54.345643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:54.346567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:10:54.347426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:54.351875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 406/793] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:54.352671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.363067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.364601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.365309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.365782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.367184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:54.368074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.370290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.395514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 388/794] 10.222.0.86 () {56 vars in 1135 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:54.397085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.479727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0b0fc-03d9-435a-b55e-d9754f88afd0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.528728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129695e-e669-4b88-a235-5dda08a5d74e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.532306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.533966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.534257 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.534535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.535223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:54.535532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.536941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.552289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 407/795] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:54.553585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.557643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.575342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.577194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.577668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.578168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.579007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:54.579492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.581145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.590260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 389/796] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:54.591552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.621520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.690852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252c932-0f79-4007-873f-96cb5d02f027 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.706413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ba896-c10a-4e90-b6ab-3aec8cca8e82 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.733288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.734153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.734435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.734712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.749445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.751095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.751235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.751859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.752228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.752573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.766019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:54.767005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:54.768126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:54.769236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:54.769236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:54.769236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:54.769450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.771120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 408/797] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:54.772310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:54.788190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:54.789433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:54.790546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:54.790546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:54.790546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:54.796309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 390/798] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:54.797359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.841946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.883203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:54.890401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ac5c-9a0d-42de-b5d0-75644a06b7db None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.908838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971757c-db57-4af1-a09e-1e9ce08ed0ab None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:54.931916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.932588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.932874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.933152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.944698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.946139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.947527 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad99912-924b-47c3-8dbf-7673c3f3a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:54.948338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad99912-924b-47c3-8dbf-7673c3f3a65e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.948963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad99912-924b-47c3-8dbf-7673c3f3a65e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.949252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad99912-924b-47c3-8dbf-7673c3f3a65e None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.949915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad99912-924b-47c3-8dbf-7673c3f3a65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:54.950225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad99912-924b-47c3-8dbf-7673c3f3a65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:54.951804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad99912-924b-47c3-8dbf-7673c3f3a65e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:54.960408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:54.961454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:54.962382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:54.962382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:54.962382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:54.964642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 409/799] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:54.965738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:54.970639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 391/800] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:54.971966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ac03-7b09-49f0-b4cf-5c4190744b6f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:54.972280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ac03-7b09-49f0-b4cf-5c4190744b6f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:54.972621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ac03-7b09-49f0-b4cf-5c4190744b6f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:54.974065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 392/801] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:54.978563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ac03-7b09-49f0-b4cf-5c4190744b6f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.074748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb2da-113d-4789-83db-4319d4775334 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.082724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.096154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ac03-7b09-49f0-b4cf-5c4190744b6f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.110970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.111632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.111911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.112179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.112852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:55.113153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.114502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.128363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 410/802] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:55.129016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.133562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd83b-9f17-40a8-bace-f5ce486463d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.134203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd83b-9f17-40a8-bace-f5ce486463d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.134454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd83b-9f17-40a8-bace-f5ce486463d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.134721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd83b-9f17-40a8-bace-f5ce486463d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.135367 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd83b-9f17-40a8-bace-f5ce486463d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:55.135670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd83b-9f17-40a8-bace-f5ce486463d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.137047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd83b-9f17-40a8-bace-f5ce486463d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.138806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.155209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 393/803] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:55.155209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefcea-9c4e-43a9-ac81-1bc7240fdc01 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.155209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefcea-9c4e-43a9-ac81-1bc7240fdc01 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.155209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefcea-9c4e-43a9-ac81-1bc7240fdc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.175413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e1aefcea-9c4e-43a9-ac81-1bc7240fdc01 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:55.176691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e1aefcea-9c4e-43a9-ac81-1bc7240fdc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:55.247514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 394/804] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:10:55.248543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aefcea-9c4e-43a9-ac81-1bc7240fdc01 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.249249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b8e80-612c-44f4-8236-6b87a29b028f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.303214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.303967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.304345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.304839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.314101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.316360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:55.332499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:55.333476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:55.334549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 411/805] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:55.335031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.371889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.374996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aefcea-9c4e-43a9-ac81-1bc7240fdc01 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.402114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.415223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.415864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.416661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.416943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.425693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.427515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:55.440073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:55.441222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:55.442335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 395/806] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:55.443530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.455312 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cdd96-a3d1-469d-a15f-abd47ca16340 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.492916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8adb75-8f77-4281-abae-ba6fcad15950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.493551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8adb75-8f77-4281-abae-ba6fcad15950 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.493844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8adb75-8f77-4281-abae-ba6fcad15950 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.494117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8adb75-8f77-4281-abae-ba6fcad15950 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.501809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8adb75-8f77-4281-abae-ba6fcad15950 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.503236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8adb75-8f77-4281-abae-ba6fcad15950 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9e8adb75-8f77-4281-abae-ba6fcad15950 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:55.515407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:55.516469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:55.517412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 412/807] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:55.518011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019caae-9200-4a79-8214-2b0658ab4ced None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.518011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019caae-9200-4a79-8214-2b0658ab4ced None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.518647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019caae-9200-4a79-8214-2b0658ab4ced None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.519568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 413/808] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:55.520109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019caae-9200-4a79-8214-2b0658ab4ced None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.563769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773a53f-90fb-4261-a066-0deb4dc2aebe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.597870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.598474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.598754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.599028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.599714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:55.600015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.601491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.606539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.613418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 396/809] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:55.614195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.624389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019caae-9200-4a79-8214-2b0658ab4ced None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.657940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf3962-48f8-4ed2-a419-fe597898c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.658543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3962-48f8-4ed2-a419-fe597898c82b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.658823 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3962-48f8-4ed2-a419-fe597898c82b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.659095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3962-48f8-4ed2-a419-fe597898c82b None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.659820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3962-48f8-4ed2-a419-fe597898c82b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:55.660125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3962-48f8-4ed2-a419-fe597898c82b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.661562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3962-48f8-4ed2-a419-fe597898c82b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.662741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.679261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 414/810] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:55.680571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310e6fc-f0b4-4c00-a495-a6815ffd8efc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.680871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310e6fc-f0b4-4c00-a495-a6815ffd8efc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.681142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310e6fc-f0b4-4c00-a495-a6815ffd8efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.698832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5310e6fc-f0b4-4c00-a495-a6815ffd8efc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:55.700009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5310e6fc-f0b4-4c00-a495-a6815ffd8efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:55.718857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4ee3-4eb9-49e5-a80b-bcb8b5bdc3ca None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.753879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.754526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.754908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.755191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.755938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:55.756278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.757748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.766421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 415/811] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:10:55.767272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310e6fc-f0b4-4c00-a495-a6815ffd8efc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.776381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 397/812] 10.222.0.86 () {56 vars in 1149 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:55.777344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:55.857850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.884810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bf3de-d88a-4fca-8008-511874eed82d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.886472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:55.891811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310e6fc-f0b4-4c00-a495-a6815ffd8efc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:55.920563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.921313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.921660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.922170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/3fecc15bbe7f4a71ac8821ea057153b2/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.924368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=3fecc15bbe7f4a71ac8821ea057153b2, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.925814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.929552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:55.930270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:55.930559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:55.930841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:55.931435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:55.932827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:55.941580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:55.944950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:55.945846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 416/813] 10.222.0.86 () {56 vars in 1129 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:55.946637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.008235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 398/814] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:55 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/3fecc15bbe7f4a71ac8821ea057153b2/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:56.008235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.065188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c3b7c-0146-4e6a-8996-da81b78f9ecf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.104242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.105025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.105435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.105810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.115355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:56.133167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa616d-1094-4211-87ff-20c4e69465db None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.177365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.177962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.178248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.178525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.189321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.189655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.190984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.191289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:56.210242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:56.211196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:56.212801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:56.212801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:56.212801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:56.212801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 399/815] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:56.212801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.229348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:56.314972 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 417/816] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:10:56.316142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.322621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526cc4a-f913-414b-96c7-a869c5109ab5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.356851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.358230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.358512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:56.358629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.358893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.359540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:56.359848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.361262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.365928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 400/817] 10.222.0.86 () {56 vars in 1124 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:56.366823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.427992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f83c-d218-4c10-849d-8908492c984f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.451055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:56.468465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.469101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.469382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.469726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] PATH_INFO: `/v3/services/network` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.470234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.471718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.474983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575a974-5650-4675-a68f-767ae9b0aa8b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:56.480554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:56.481543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:56.482975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 418/818] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:56.484299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.524864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.525485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.525766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.526040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.526687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:56.526990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.528816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.542253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 401/819] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:56.543953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.594217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8a13a-2f67-4bfc-84a5-960b152132ca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.596370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:56.632050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.633341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.633831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.634348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.646171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.648040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.649988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea5d99-5bf6-4ff2-8b5b-817a539b07a4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:56.664501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:56.665469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:56.666348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:56.666348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:56.666348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:56.668141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 419/820] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:56.669212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.692085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.692667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.692948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.693228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.693866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:56.694172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.695559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.700404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 402/821] 10.222.0.86 () {56 vars in 1124 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:56.701205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.703691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:56.782994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23cd0a-a97e-4564-b99e-d935ce609da5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.821061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.821943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.822374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.822796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.823615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:56.824069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.825836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.832558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 420/822] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:56.833654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:56.856131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:56.924168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe63c2e-8db2-4a0a-b3cb-37a2759718d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.943549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c742-2298-49e8-856c-5202b5d77af5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:56.960813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.961740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.962205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.962649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.970193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.971890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.978393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:56.979002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:56.979286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:56.979563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:56.980238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:56.980544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:56.981897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:56.988769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:56.989631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:56.990517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:56.991572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 403/823] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:56.992479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.003215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 421/824] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:57.004329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.058196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:57.096659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:57.103408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a7e4d-ed00-4572-9618-28fb9b9a7e37 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:57.122684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4a578-9bc2-4a00-8587-bf21fa4806e9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:57.140268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:57.140904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.141165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.141441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.142101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:57.143493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:57.159551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:57.173306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.173306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.173306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.173306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:57.173306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:57.173306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:57.173795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 422/825] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:10:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:57.173795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.237459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 404/826] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:57.238575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.303368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede65992-c96f-4ba4-9c61-ada91b299915 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:57.360739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:57.362017 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.362642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.363122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.363326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632fd80-3ee0-4228-ad7f-3f8fb18d8e15 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:57.364385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:57.365233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:57.368057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:57.379556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:57.381226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:57.389024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 423/827] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:57.390237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.410597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:57.411241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.411517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.411791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.421550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:57.423378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:10:57.437714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:57.438640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:10:57.439510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:57.444043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 405/828] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:57.445295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.524833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777d1e-32b3-4114-9429-16d29c7ca242 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:57.569327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:57.570021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.570311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.570595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.571396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:57.573441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:57.578321 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253624d2-2184-48fd-a5a7-c9629f20b714 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:57.617545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:57.618360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.618703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.619044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/5409b17aa2224f0fa60de95d5fc2e892/roles/6cb47f6dfcc046b9b43619b5f16931ad` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.634541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=5409b17aa2224f0fa60de95d5fc2e892, role_id=6cb47f6dfcc046b9b43619b5f16931ad)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:57.635986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:57.660235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 424/829] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:10:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:10:57.660235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.734609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:57.745729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 406/830] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:10:57 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/5409b17aa2224f0fa60de95d5fc2e892/roles/6cb47f6dfcc046b9b43619b5f16931ad => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:10:57.814168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67875c02-522a-4d75-8b1b-2af928a8848b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:57.866491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e90688-1227-40b9-97df-fff9c6f32efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:57.867121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90688-1227-40b9-97df-fff9c6f32efe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.867403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90688-1227-40b9-97df-fff9c6f32efe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.867685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e90688-1227-40b9-97df-fff9c6f32efe None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.868445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e90688-1227-40b9-97df-fff9c6f32efe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:57.868757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e90688-1227-40b9-97df-fff9c6f32efe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:57.870244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e90688-1227-40b9-97df-fff9c6f32efe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:57.885107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 425/831] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:57.892249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:57.924570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:57.956669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8390-4733-40c3-89ad-05f278c7ed21 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.957217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8390-4733-40c3-89ad-05f278c7ed21 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.957423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8390-4733-40c3-89ad-05f278c7ed21 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.959394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 426/832] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:57.965629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ba11-8950-4654-b6e1-6b1917234866 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:57.965914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ba11-8950-4654-b6e1-6b1917234866 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:57.966194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502ba11-8950-4654-b6e1-6b1917234866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:57.991064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3502ba11-8950-4654-b6e1-6b1917234866 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:57.993178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3502ba11-8950-4654-b6e1-6b1917234866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:58.022455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269d6a8-ddd9-48e4-9d27-6986a54ccdd5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:58.073149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:58.073749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:58.074036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:58.074307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:58.075043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=748eb93057e245c1b8183dbe0340fa3f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:58.075352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:58.078557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:58.085355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 407/833] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:10:57 2022] GET /identity/v3/role_assignments?user.id=748eb93057e245c1b8183dbe0340fa3f&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:58.095267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 427/834] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:10:58.374945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:58.467926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:58.485260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a5b3-ad60-4729-af1d-866f6f26da2c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:58.521903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:58.522938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:58.523416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:58.523911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:58.535601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:10:58.541304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:58.542255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:10:58.543092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:58.546195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 408/835] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:58.552662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502ba11-8950-4654-b6e1-6b1917234866 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:58.595869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:58.657536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502ba11-8950-4654-b6e1-6b1917234866 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:58.693821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:58.694769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:58.695249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:58.695744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:58.696758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:58.697259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:58.698861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:58.708052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 428/836] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:58.713363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:58.823944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435481f7-9b24-48ce-b580-8259e07f62fe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:58.859744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:58.860418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:58.860704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:58.860983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:58.872150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:58.873855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:58.882068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:58.888494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:58.889429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:58.890700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:58.890700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:58.890700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:58.890700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 409/837] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:58.896053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:59.009253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034a8f6-9b47-444a-a46b-b2ab8c93e507 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:59.010740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:59.048934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:59.049563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.049853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.050132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.050777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:59.051089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:59.052573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:59.064827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 429/838] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:59.070062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:59.173738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d08eaf-d845-42a3-a5e3-0f1e628cc304 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:59.215648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23e435-71db-4b3f-a1af-8064ef270ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:59.216632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e435-71db-4b3f-a1af-8064ef270ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.217125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e435-71db-4b3f-a1af-8064ef270ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.217611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e435-71db-4b3f-a1af-8064ef270ce6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.225879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23e435-71db-4b3f-a1af-8064ef270ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:59.227617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23e435-71db-4b3f-a1af-8064ef270ce6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1d23e435-71db-4b3f-a1af-8064ef270ce6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:10:59.240158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:59.241175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 11:10:59.242102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:59.244770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 410/839] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:10:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:59.253342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:59.356433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205cc53-a22b-417c-9514-b297889b27ca None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.357113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205cc53-a22b-417c-9514-b297889b27ca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.357597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205cc53-a22b-417c-9514-b297889b27ca None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.359359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 411/840] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:59.363887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b82e9-90b2-4c76-9207-8a29a3873bf7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:59.365290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f86b8-21ab-4bf4-b037-0ae50c7fd90a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.365793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f86b8-21ab-4bf4-b037-0ae50c7fd90a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.366274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f86b8-21ab-4bf4-b037-0ae50c7fd90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.384950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-504f86b8-21ab-4bf4-b037-0ae50c7fd90a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:59.386655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-504f86b8-21ab-4bf4-b037-0ae50c7fd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:59.397067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:59.397682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.397962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.398232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.398961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:10:59.399265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:59.400841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:59.420029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 430/841] 10.222.0.86 () {56 vars in 1135 bytes} [Thu Aug 18 11:10:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:10:59.425239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:59.452507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:59.455263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:59.468388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 412/842] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:10:59.540373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174331c4-024d-467b-ba2d-f9be3f529a69 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:59.578535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:59.579143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.579469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.579747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.652924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:59.654360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:59.675537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:59.740980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f86b8-21ab-4bf4-b037-0ae50c7fd90a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:59.756989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 431/843] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:10:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 11:10:59.762341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:59.849830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f86b8-21ab-4bf4-b037-0ae50c7fd90a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:59.884169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc70ebf-fcfb-48d9-929a-7f28f67dc14a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:10:59.890955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faf539-4f1f-42dd-89b5-fd8880bd4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:59.891598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf539-4f1f-42dd-89b5-fd8880bd4596 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.891883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf539-4f1f-42dd-89b5-fd8880bd4596 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.892159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf539-4f1f-42dd-89b5-fd8880bd4596 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.892786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf539-4f1f-42dd-89b5-fd8880bd4596 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:59.894199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf539-4f1f-42dd-89b5-fd8880bd4596 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-81faf539-4f1f-42dd-89b5-fd8880bd4596 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:59.903299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:59.904899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:10:59.905727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 413/844] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:10:59.906535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574420e-79f2-43dd-9eed-e88468067285 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.906535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574420e-79f2-43dd-9eed-e88468067285 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.906535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574420e-79f2-43dd-9eed-e88468067285 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.911542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 414/845] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:10:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:10:59.912923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd9c0-50a9-47d8-9d9a-775902cb6769 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.913211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd9c0-50a9-47d8-9d9a-775902cb6769 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.913486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fd9c0-50a9-47d8-9d9a-775902cb6769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.913596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:10:59.928889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:10:59.929526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:10:59.929813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:10:59.930091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:10:59.932094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a65fd9c0-50a9-47d8-9d9a-775902cb6769 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:10:59.933400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a65fd9c0-50a9-47d8-9d9a-775902cb6769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:10:59.942010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:10:59.943457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:10:59.958864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:10:59.959827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:10:59.960755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:10:59.960755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:10:59.960755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:10:59.960755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 432/846] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:10:59.960988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:10:59.992951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:00.011434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 415/847] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:10:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:00.012300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fd9c0-50a9-47d8-9d9a-775902cb6769 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.085432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74424c-a7f1-4821-bc85-39380179eca8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.131214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fd9c0-50a9-47d8-9d9a-775902cb6769 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.135430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.136269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.136727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.137175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.138008 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:00.138623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.140646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.147964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 433/848] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:10:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:00.154003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.179759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.180408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.180778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.181051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.182292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:00.182597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.184308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.197572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:00.201936 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 416/849] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:00.209104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.256978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:00.275980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979a22-889b-4b8d-adcb-597e6bf7a912 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.312231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd078-5ea8-4172-9e30-16445b30206c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.314005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e2746-ce5b-4b1e-8ea1-96ddd93a1ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.314617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2746-ce5b-4b1e-8ea1-96ddd93a1ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.314904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2746-ce5b-4b1e-8ea1-96ddd93a1ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.315178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e2746-ce5b-4b1e-8ea1-96ddd93a1ee4 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.315810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e2746-ce5b-4b1e-8ea1-96ddd93a1ee4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:00.316116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e2746-ce5b-4b1e-8ea1-96ddd93a1ee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.317503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e2746-ce5b-4b1e-8ea1-96ddd93a1ee4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.321828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 434/850] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:00.323039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4c1df-d457-458e-a396-d925a875d32d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.323328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4c1df-d457-458e-a396-d925a875d32d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.323605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4c1df-d457-458e-a396-d925a875d32d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.328786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 435/851] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:00.328786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4c1df-d457-458e-a396-d925a875d32d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.353245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3dfc8-ff2e-40f8-9090-35304e61d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.353898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3dfc8-ff2e-40f8-9090-35304e61d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.354182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3dfc8-ff2e-40f8-9090-35304e61d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.354458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3dfc8-ff2e-40f8-9090-35304e61d4a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.363064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3dfc8-ff2e-40f8-9090-35304e61d4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.364571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3dfc8-ff2e-40f8-9090-35304e61d4a0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fea3dfc8-ff2e-40f8-9090-35304e61d4a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:00.376927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:00.378089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:00.379395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 417/852] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:00.379898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66bef0-3612-4d86-8af8-c7f83644b500 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.379898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66bef0-3612-4d86-8af8-c7f83644b500 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.380144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66bef0-3612-4d86-8af8-c7f83644b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.400085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9d66bef0-3612-4d86-8af8-c7f83644b500 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:00.401360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d66bef0-3612-4d86-8af8-c7f83644b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:00.461346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:00.466934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4c1df-d457-458e-a396-d925a875d32d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.478035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 418/853] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:00.478878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66bef0-3612-4d86-8af8-c7f83644b500 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.522177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:00.524120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.524794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.525076 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.525351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.536936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:00.541979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:00.542944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:11:00.543800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:00.548786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 436/854] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:00.549657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.615159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66bef0-3612-4d86-8af8-c7f83644b500 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.654132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.654754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.655095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.655377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.656112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:00.656458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.658092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.673584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6df2-8ff2-461a-a22b-15e722c541a6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.675544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 419/855] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:00.676454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.718643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.719961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.720487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.721300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.722583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:00.723096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.725261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.737223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 437/856] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:00.743130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.774983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:00.777896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:00.784860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec75d-41c2-4c6c-870b-ecd9b8985ef5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.821855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.822567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.822849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.823125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.823855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=3fecc15bbe7f4a71ac8821ea057153b2) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:00.824167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.825664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.836904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 420/857] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/role_assignments?user.id=3fecc15bbe7f4a71ac8821ea057153b2&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:00.836904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.866334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad95f-62f1-4725-98ec-535c3eb8c342 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:00.907792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:00.908498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:00.908787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:00.909068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:00.921066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:00.922995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:00.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:00.942650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:00.943557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:00.943557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:00.943557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:00.951234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 438/858] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:00.952674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:00.974369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240551de-658e-4834-ae2d-2829cae784d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:01.014983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:01.015799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:01.015912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:01.016177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:01.016807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:01.018182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:01.032248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:01.033222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:01.034142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:01.036328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 421/859] 10.222.0.86 () {56 vars in 1132 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:01.039803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:01.047442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:01.067833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:01.080199 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fec3b2-2460-453a-bdcd-758a177ea805 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:01.125996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:01.126653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:01.126873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:01.127146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:01.127894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:01.128219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:01.129696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:01.143808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 439/860] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:01.149386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:01.170034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8958d0-8eab-46dc-9230-5ef41fbfca48 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:01.219535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:01.226102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:01.226643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:01.227165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:01.228025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:01.228560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:01.230330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:01.240305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 422/861] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:01.242166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:01.270814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6c90d-be25-4637-a34d-f4e9572dffbf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:01.307933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:01.308646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:01.308930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:01.309205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:01.317815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:01.319502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:01.332565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:01.333722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:01.334714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:01.335722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:01.337204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:01.338553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 440/862] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:11:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:01.340003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:01.354745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6e5e-bc4e-424b-9927-e0790c96db2c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:01.391969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:01.392646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:01.392926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:01.393203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:01.394057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:01.394364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:01.395783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:01.408668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 423/863] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:01.452649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2fdc4-76d9-41e6-b51b-e8146f41da90 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:01.494196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:01.494735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:01.495016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:01.495290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:01.496033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:01.496588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:01.498786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:01.524198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 441/864] 10.222.0.86 () {56 vars in 1149 bytes} [Thu Aug 18 11:11:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:01.526203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:01.634111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3742a72-3496-45e7-ad7a-5bcf42eb3d7e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:01.671163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:01.671767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:01.672044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:01.672396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:01.691209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:01.747532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:01.749355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:01.855828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 424/865] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:11:01.861383 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:01.919035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:01.972942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b255e2-05bd-4c17-9d70-bf9de100e66b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:02.009312 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:02.010313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.010798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.011273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.023603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:02.025453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:02.040900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:02.041933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:02.042803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:02.042803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:02.042803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:02.045182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 442/866] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:02.050718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:02.103732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:02.154685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a6168-ba53-4c0c-9d4c-a137cb2e75e3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:02.189718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283587d0-7dac-4226-a696-25d2d898f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:02.190693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283587d0-7dac-4226-a696-25d2d898f471 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.191194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283587d0-7dac-4226-a696-25d2d898f471 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.191665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283587d0-7dac-4226-a696-25d2d898f471 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.192535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283587d0-7dac-4226-a696-25d2d898f471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:02.193086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283587d0-7dac-4226-a696-25d2d898f471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:02.194655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283587d0-7dac-4226-a696-25d2d898f471 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:02.213159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 425/867] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:02.219285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:02.330486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb078f-67f0-4655-9403-b5a20d61ec3b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:02.333307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:02.368666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:02.369681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.370166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.370641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.373025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33c8d-0e67-4251-bb07-8501ec54fdc5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.373243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33c8d-0e67-4251-bb07-8501ec54fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.373523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e33c8d-0e67-4251-bb07-8501ec54fdc5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.376174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 426/868] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:02.379248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:02.380461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be30cb-8b95-4d59-8b10-91de1098e2fc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.380758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be30cb-8b95-4d59-8b10-91de1098e2fc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.381220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be30cb-8b95-4d59-8b10-91de1098e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.381653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:02.395234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:02.396229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:02.397256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:02.399266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 443/869] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:02.403167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c8be30cb-8b95-4d59-8b10-91de1098e2fc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:02.405301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:02.406405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c8be30cb-8b95-4d59-8b10-91de1098e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:02.477852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 427/870] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:02.519436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6497-870d-46c9-b2c7-b2512b9d2b71 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:02.554981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:02.555589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.555873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.556147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.556927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:02.557236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:02.558666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:02.576323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 444/871] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:02.578353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be30cb-8b95-4d59-8b10-91de1098e2fc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:02.625214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:02.685871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be30cb-8b95-4d59-8b10-91de1098e2fc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:02.720757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af07f1-336d-4112-a246-c7e2e02683e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:02.721417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af07f1-336d-4112-a246-c7e2e02683e5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.721703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af07f1-336d-4112-a246-c7e2e02683e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.721976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af07f1-336d-4112-a246-c7e2e02683e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.722701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af07f1-336d-4112-a246-c7e2e02683e5 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=5409b17aa2224f0fa60de95d5fc2e892) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:02.723010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af07f1-336d-4112-a246-c7e2e02683e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:02.724539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af07f1-336d-4112-a246-c7e2e02683e5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:02.736353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 428/872] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:02 2022] GET /identity/v3/role_assignments?user.id=5409b17aa2224f0fa60de95d5fc2e892&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:02.766004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:02.794100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:02.881618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0437196-847b-462d-b306-5c0da2359b4c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:02.896893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9553187-f8d5-43e1-9b8c-63762a471947 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.897395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9553187-f8d5-43e1-9b8c-63762a471947 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.897472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9553187-f8d5-43e1-9b8c-63762a471947 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.899047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 429/873] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:02.904481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee45ed-ad7b-47d5-9fba-c23c847d796c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.912025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee45ed-ad7b-47d5-9fba-c23c847d796c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.912025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee45ed-ad7b-47d5-9fba-c23c847d796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.924329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:02.924329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:02.924680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:02.925071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:02.925818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:02.927275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:02.929896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-06ee45ed-ad7b-47d5-9fba-c23c847d796c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:02.931090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06ee45ed-ad7b-47d5-9fba-c23c847d796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:03.009150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 430/874] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:03.014515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 445/875] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:11:02 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:03.285359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee45ed-ad7b-47d5-9fba-c23c847d796c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:03.322262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:03.393677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee45ed-ad7b-47d5-9fba-c23c847d796c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:03.436191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633d0a-fc02-4241-8e42-60d0cf4c3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:03.436865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633d0a-fc02-4241-8e42-60d0cf4c3889 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:03.437147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633d0a-fc02-4241-8e42-60d0cf4c3889 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:03.437420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633d0a-fc02-4241-8e42-60d0cf4c3889 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:03.438011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8633d0a-fc02-4241-8e42-60d0cf4c3889 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:03.439383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8633d0a-fc02-4241-8e42-60d0cf4c3889 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e8633d0a-fc02-4241-8e42-60d0cf4c3889 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:03.448263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:03.449225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:03.451023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 431/876] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:03.457387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:03.464570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849ecc-30c2-435e-8304-3c67f0d73c53 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:03.464855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849ecc-30c2-435e-8304-3c67f0d73c53 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:03.465134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849ecc-30c2-435e-8304-3c67f0d73c53 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:03.467247 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 432/877] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:03.472058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb19ba2-c01e-42c9-887d-e9dbe7faa89f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:03.472383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb19ba2-c01e-42c9-887d-e9dbe7faa89f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:03.472661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb19ba2-c01e-42c9-887d-e9dbe7faa89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:03.496880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-deb19ba2-c01e-42c9-887d-e9dbe7faa89f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:03.498451 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-deb19ba2-c01e-42c9-887d-e9dbe7faa89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:03.570647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:03.588068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbd3cd-20d2-4068-86a7-199929ce0951 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:03.592347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 433/878] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:03.630099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:03.631112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:03.631629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:03.632125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:03.633110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:03.633626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:03.635220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:03.642016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 446/879] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:03.647957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb19ba2-c01e-42c9-887d-e9dbe7faa89f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:03.674747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:03.755462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb19ba2-c01e-42c9-887d-e9dbe7faa89f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:03.790716 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d86c35-5a40-4ca6-a108-0c2695995911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:03.791689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86c35-5a40-4ca6-a108-0c2695995911 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:03.792175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86c35-5a40-4ca6-a108-0c2695995911 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:03.792691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d86c35-5a40-4ca6-a108-0c2695995911 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:03.793541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d86c35-5a40-4ca6-a108-0c2695995911 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:03.794048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d86c35-5a40-4ca6-a108-0c2695995911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:03.796604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d86c35-5a40-4ca6-a108-0c2695995911 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:03.801789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 434/880] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:03.904815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:04.014711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a553db-0cd3-40f6-a1bc-e6b10f150e30 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:04.050665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467c370-8c8a-4610-90ca-ae1b08d9ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:04.051286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c370-8c8a-4610-90ca-ae1b08d9ba07 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:04.051566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c370-8c8a-4610-90ca-ae1b08d9ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:04.051843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467c370-8c8a-4610-90ca-ae1b08d9ba07 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:04.052527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467c370-8c8a-4610-90ca-ae1b08d9ba07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:04.053898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467c370-8c8a-4610-90ca-ae1b08d9ba07 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:04.125038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 447/881] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:11:03 2022] POST /identity/v3/services => generated 269 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:04.839255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dec3-3e2c-4409-a41c-44fddc5f619b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:04.839773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dec3-3e2c-4409-a41c-44fddc5f619b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:04.839852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1dec3-3e2c-4409-a41c-44fddc5f619b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:04.842001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 435/882] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:04.847321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0717-ae5d-47a7-a443-85c3efd2ca19 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:04.858092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0717-ae5d-47a7-a443-85c3efd2ca19 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:04.858092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0717-ae5d-47a7-a443-85c3efd2ca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:04.867863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-125b0717-ae5d-47a7-a443-85c3efd2ca19 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:04.869162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-125b0717-ae5d-47a7-a443-85c3efd2ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:04.871285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:04.952411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 448/883] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:05.023974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e45c2-3706-4477-8d31-0227e9521bc3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.024320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e45c2-3706-4477-8d31-0227e9521bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.024569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e45c2-3706-4477-8d31-0227e9521bc3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.026152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 436/884] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:05.031531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100564f3-a0e7-4cda-b753-e11b0e6e94d7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.031819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100564f3-a0e7-4cda-b753-e11b0e6e94d7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.032093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100564f3-a0e7-4cda-b753-e11b0e6e94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.054389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-100564f3-a0e7-4cda-b753-e11b0e6e94d7 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:05.055561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-100564f3-a0e7-4cda-b753-e11b0e6e94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:05.124624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 449/885] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:05.242969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e45c2-3706-4477-8d31-0227e9521bc3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:05.337865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:05.352263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e45c2-3706-4477-8d31-0227e9521bc3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:05.386519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:05.387087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.387376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.388381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.399590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:05.400894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100564f3-a0e7-4cda-b753-e11b0e6e94d7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:05.405938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:05.406911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:05.407758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:05.412626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 437/886] 10.222.0.86 () {56 vars in 1120 bytes} [Thu Aug 18 11:11:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:05.414208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:05.472559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:05.516769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100564f3-a0e7-4cda-b753-e11b0e6e94d7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:05.547362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50970db5-6a0a-438b-af51-73efed69e4c4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:05.555090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:05.555728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.556007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.556311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.556899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:05.558250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:05.568969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:05.570007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:11:05.570957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:05.574950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 450/887] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:11:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:05.576317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:05.601945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:05.603191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.604112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.604844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.605732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:05.606462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:05.609291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:05.622960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 438/888] 10.222.0.86 () {56 vars in 1115 bytes} [Thu Aug 18 11:11:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:05.629024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:05.643600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:05.712817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7de542-6ac3-4d7f-bf56-545376731268 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:05.745064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2663f-c4a2-4681-8353-73fa50a68fd7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:05.753267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:05.764553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:05.765392 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.765825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.766258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.773762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:05.773762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:05.773762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:05.777861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 451/889] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:11:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:05.784289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:05.788307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1489-373b-4fb4-96de-5f3417459f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:05.789778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1489-373b-4fb4-96de-5f3417459f2e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.789778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1489-373b-4fb4-96de-5f3417459f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.789778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1489-373b-4fb4-96de-5f3417459f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.805792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1489-373b-4fb4-96de-5f3417459f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:05.807294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1489-373b-4fb4-96de-5f3417459f2e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f1bd1489-373b-4fb4-96de-5f3417459f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:05.824422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:05.825628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:05.826953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:05.826953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:05.826953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:05.830754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 439/890] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:05.831960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c10c-f2d0-4efd-870b-f77ad9bc13f3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.832285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c10c-f2d0-4efd-870b-f77ad9bc13f3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.832564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c10c-f2d0-4efd-870b-f77ad9bc13f3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.836676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 440/891] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:05.836676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413c10c-f2d0-4efd-870b-f77ad9bc13f3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:05.902449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def647-b37c-4d32-84fa-ade711b4107d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:05.913806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:05.938488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f83d6-1729-4167-afd2-d7cd4c38b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:05.939096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f83d6-1729-4167-afd2-d7cd4c38b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.939578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f83d6-1729-4167-afd2-d7cd4c38b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.939859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f83d6-1729-4167-afd2-d7cd4c38b2d9 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.940527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f83d6-1729-4167-afd2-d7cd4c38b2d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:05.940838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f83d6-1729-4167-afd2-d7cd4c38b2d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:05.942291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f83d6-1729-4167-afd2-d7cd4c38b2d9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:05.947811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 452/892] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:11:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:05.949297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21f5de-4688-4078-97ab-244ae7136181 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.949591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21f5de-4688-4078-97ab-244ae7136181 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.949869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21f5de-4688-4078-97ab-244ae7136181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.961204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413c10c-f2d0-4efd-870b-f77ad9bc13f3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:05.971363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fd21f5de-4688-4078-97ab-244ae7136181 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:05.972903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fd21f5de-4688-4078-97ab-244ae7136181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:05.997015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:05.997747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:05.998195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:05.998615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:05.999418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:05.999875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.001454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.014598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 441/893] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:06.015638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.034765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:06.059174 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 453/894] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:06.061004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21f5de-4688-4078-97ab-244ae7136181 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.137405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1d83e-8559-4915-8482-d61e7b572ab8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:06.159773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:06.171954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb38c53-cfe1-4548-a910-b2b09fde132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:06.172597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb38c53-cfe1-4548-a910-b2b09fde132e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.172881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb38c53-cfe1-4548-a910-b2b09fde132e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.173157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb38c53-cfe1-4548-a910-b2b09fde132e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.173868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb38c53-cfe1-4548-a910-b2b09fde132e None admin] RBAC: Adding query filter params (interface=public, service_id=0e1d2033b681432c95125d87522ca675, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:06.174176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb38c53-cfe1-4548-a910-b2b09fde132e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.175550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb38c53-cfe1-4548-a910-b2b09fde132e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.176431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21f5de-4688-4078-97ab-244ae7136181 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:06.186640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 442/895] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/endpoints?service_id=0e1d2033b681432c95125d87522ca675&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:06.186640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6b26-8f6a-4597-af39-a3b2acac48b9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.186640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6b26-8f6a-4597-af39-a3b2acac48b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.186640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d6b26-8f6a-4597-af39-a3b2acac48b9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.186640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 443/896] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:06.188756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d6b26-8f6a-4597-af39-a3b2acac48b9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.219446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d03e-0d6c-4455-b9c6-adc414fcf269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:06.220078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d03e-0d6c-4455-b9c6-adc414fcf269 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.223552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d03e-0d6c-4455-b9c6-adc414fcf269 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.223552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d03e-0d6c-4455-b9c6-adc414fcf269 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.230620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902d03e-0d6c-4455-b9c6-adc414fcf269 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.232814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902d03e-0d6c-4455-b9c6-adc414fcf269 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b902d03e-0d6c-4455-b9c6-adc414fcf269 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:06.244848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:06.245803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:06.246727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 454/897] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:06.248043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a4fb3-51a9-46d2-a80b-942b8425bde8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.248112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a4fb3-51a9-46d2-a80b-942b8425bde8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.248857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a4fb3-51a9-46d2-a80b-942b8425bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.267086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-915a4fb3-51a9-46d2-a80b-942b8425bde8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:06.268327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-915a4fb3-51a9-46d2-a80b-942b8425bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:06.308419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d6b26-8f6a-4597-af39-a3b2acac48b9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:06.313046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:06.338867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 455/898] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:06.339697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a4fb3-51a9-46d2-a80b-942b8425bde8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.362080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:06.362970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.363255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.363689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.364647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.366521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.376385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 444/899] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:11:06.377250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.460352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:06.461852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a4fb3-51a9-46d2-a80b-942b8425bde8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:06.515329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358cba-410a-4389-bac5-c32574a469be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:06.516633 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358cba-410a-4389-bac5-c32574a469be None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.517115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358cba-410a-4389-bac5-c32574a469be None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.518661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358cba-410a-4389-bac5-c32574a469be None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.519857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358cba-410a-4389-bac5-c32574a469be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:06.520403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358cba-410a-4389-bac5-c32574a469be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.521405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e671-2eff-49f5-a8a2-bb7f1f56b8ec None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:06.522244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358cba-410a-4389-bac5-c32574a469be None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.545270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 456/900] 10.222.0.86 () {56 vars in 1149 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:06.550966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358cba-410a-4389-bac5-c32574a469be None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.567320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:06.567936 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.568363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.568643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.569424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.570801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.588842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:06.652462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 445/901] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:11:06 2022] POST /identity/v3/services => generated 241 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:06.653693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.656787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358cba-410a-4389-bac5-c32574a469be None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:06.718775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:06.720691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.721199 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.721717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.807652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.809138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.810555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae41e5d-f18d-48bd-9e68-1567cc269d23 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:06.822584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:06.851063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:06.858473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:06.860929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:06.861216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:06.861497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:06.862106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:06.863503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:06.876349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:06.881460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:06.882924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 446/902] 10.222.0.86 () {56 vars in 1132 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:06.885366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:06.939121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 457/903] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 11:11:06.945119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.029966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdda21-f176-42c9-8f7a-bbc7f880930e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.062088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589248b4-eb03-4bea-860c-8a428f079dec None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.079931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.080936 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.081652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.082543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.083400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:07.083912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.086067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.098309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 447/904] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:07.099324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.101191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:07.107601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.108402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.116331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.116331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.123219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.124954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:07.141497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:07.142497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:07.143386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:07.143386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:07.143386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:07.143386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 458/905] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:07.148042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.158404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:07.241302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e5ad-4996-4d7d-91d6-e10ffaf0880d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.277804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a6993-bfb2-47b1-8243-73eb94b327a0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.284483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.285156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.285441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.285715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.286360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:07.286661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.288303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.298127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 448/906] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:07.299203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.327378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.327992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.328301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.328581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.329234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:07.329541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.331066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.348521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 459/907] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:07.349560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.399301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:07.442578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a358aa-9e48-4115-a88d-9d18a79d3b3b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.444718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:07.482501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99550aa-3738-4a98-93eb-280c0694b68e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.489489 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.490446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.491477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.491966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.493378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] RBAC: Adding query filter params (interface=public, service_id=a33896b415ab4f24b8bf779825e84a4c, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:07.493906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.496477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.508716 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 449/908] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:11:07 2022] GET /identity/v3/endpoints?service_id=a33896b415ab4f24b8bf779825e84a4c&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:07.509909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.529743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.530624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.530912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.531195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.540753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.542131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:07.560424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:07.561386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:07.562271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:07.565581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 460/909] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:07.570844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.630384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eab5b-63c3-40f1-a807-084927ef7a38 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.681554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.681554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.681862 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.682390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.682680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.684035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.691062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 450/910] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:11:07 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:11:07.712196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d8ace-56eb-4020-b670-6fce2e03456e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.714442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:07.753509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e056b5-2178-4d77-a4fc-25b216cf67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.754524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e056b5-2178-4d77-a4fc-25b216cf67b2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.755482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e056b5-2178-4d77-a4fc-25b216cf67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.756270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e056b5-2178-4d77-a4fc-25b216cf67b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.757213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e056b5-2178-4d77-a4fc-25b216cf67b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:07.757773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e056b5-2178-4d77-a4fc-25b216cf67b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.759444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e056b5-2178-4d77-a4fc-25b216cf67b2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.773474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 461/911] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:07.780513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:07.818654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:07.895106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626968-d8ea-4168-b176-a77a27385967 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:07.931286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b16ec9-0433-4fc3-9e1e-53a35068e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:07.932298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16ec9-0433-4fc3-9e1e-53a35068e63c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:07.932785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16ec9-0433-4fc3-9e1e-53a35068e63c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:07.933257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16ec9-0433-4fc3-9e1e-53a35068e63c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:07.934206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b16ec9-0433-4fc3-9e1e-53a35068e63c None admin] RBAC: Adding query filter params (role.id=d2766df682dc448ca6aff60f115c96c1, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=5409b17aa2224f0fa60de95d5fc2e892) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:07.935391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b16ec9-0433-4fc3-9e1e-53a35068e63c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:07.937145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b16ec9-0433-4fc3-9e1e-53a35068e63c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:07.943626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 451/912] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:07 2022] GET /identity/v3/role_assignments?user.id=5409b17aa2224f0fa60de95d5fc2e892&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=d2766df682dc448ca6aff60f115c96c1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:08.394759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd166df-fe95-4dcf-930f-03624fa07a5b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:08.395261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd166df-fe95-4dcf-930f-03624fa07a5b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:08.395338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd166df-fe95-4dcf-930f-03624fa07a5b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:08.397037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 462/913] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:08.402179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521d76-0b5b-4bf2-ac65-0b79d58ce8aa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:08.402598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521d76-0b5b-4bf2-ac65-0b79d58ce8aa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:08.402769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521d76-0b5b-4bf2-ac65-0b79d58ce8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:08.422077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ba521d76-0b5b-4bf2-ac65-0b79d58ce8aa None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:08.423275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ba521d76-0b5b-4bf2-ac65-0b79d58ce8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:08.495102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 452/914] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:08.671809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030bc8f-fc4f-42a1-b090-76534bf115e7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:08.672136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030bc8f-fc4f-42a1-b090-76534bf115e7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:08.672416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030bc8f-fc4f-42a1-b090-76534bf115e7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:08.674009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 463/915] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:08.679341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df8fd-866b-4582-90e0-e5482f7527ed None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:08.679636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df8fd-866b-4582-90e0-e5482f7527ed None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:08.679916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df8fd-866b-4582-90e0-e5482f7527ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:08.698769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ae7df8fd-866b-4582-90e0-e5482f7527ed None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:08.699945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ae7df8fd-866b-4582-90e0-e5482f7527ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:08.719227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:08.770631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 453/916] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:08.772510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030bc8f-fc4f-42a1-b090-76534bf115e7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:08.883880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030bc8f-fc4f-42a1-b090-76534bf115e7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:08.927703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:08.928407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:08.928759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:08.929032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:08.929622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:08.930980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:08.957973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:08.959033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 11:11:08.959885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:08.964083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 464/917] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:11:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:08.983233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df8fd-866b-4582-90e0-e5482f7527ed None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.060323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.096998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:09.144185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df8fd-866b-4582-90e0-e5482f7527ed None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:09.176516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbd4e0-699f-452b-8127-aa3064269f6f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:09.213395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:09.214034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.214414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.214690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.215276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:09.217218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:09.227238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:09.228273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:09.229113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 465/918] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:09.235266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.240438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:09.241342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.241842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.242318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.244924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:09.245459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:09.247665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:09.257919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 454/919] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:11:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:09.265206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.308597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:09.394709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:09.414158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9529acb-d32a-4176-84d5-ccea469dba9c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:09.464131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9d1d-2d8f-446a-9a57-a8d5076f09e7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:09.490612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:09.491254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.491538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.491811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.496606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:09.496606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:09.499253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:09.516391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 466/920] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:09.518344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.530095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:09.533132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.533843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.535019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.536293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:09.536823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:09.538845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:09.549982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 455/921] 10.222.0.86 () {56 vars in 1114 bytes} [Thu Aug 18 11:11:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:09.551827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.642709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:09.648584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84551d38-4cec-4679-84b9-dd2a638ab761 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:09.663455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d94e5-8ec4-4339-b400-04e54e14a238 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:09.692372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:09.693313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.693605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.693885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.694794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:09.695112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:09.696768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:09.708592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 467/922] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:09.709611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.711290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29dba9-81e7-493a-8ebf-2e0080381af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:09.711979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29dba9-81e7-493a-8ebf-2e0080381af7 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.712283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29dba9-81e7-493a-8ebf-2e0080381af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.712557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29dba9-81e7-493a-8ebf-2e0080381af7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.713220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29dba9-81e7-493a-8ebf-2e0080381af7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:09.714600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29dba9-81e7-493a-8ebf-2e0080381af7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:09.730717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:09.797389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 456/923] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:11:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:09.799116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a259b-be0e-41ab-8260-081db0156ebd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.799437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a259b-be0e-41ab-8260-081db0156ebd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.799783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a259b-be0e-41ab-8260-081db0156ebd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.804260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 457/924] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:09.806730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacc9b-ef87-4b47-9e99-7c0307001593 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.807024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacc9b-ef87-4b47-9e99-7c0307001593 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.807340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacc9b-ef87-4b47-9e99-7c0307001593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.829882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334a88-da67-44c0-b90a-e216953efe0e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:09.851127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0ddacc9b-ef87-4b47-9e99-7c0307001593 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:09.852403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ddacc9b-ef87-4b47-9e99-7c0307001593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:09.904397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:09.905502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.906625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.907091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.908493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] RBAC: Adding query filter params (interface=public, service_id=ed2801d3adf74cf1b9e1ed09678fda16, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:09.909304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:09.911464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:09.921155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 468/925] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:11:09 2022] GET /identity/v3/endpoints?service_id=ed2801d3adf74cf1b9e1ed09678fda16&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:09.929508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:09.943881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 458/926] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:09.945231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78dd4-a3bc-4b99-a66c-d4901ea82918 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.945523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78dd4-a3bc-4b99-a66c-d4901ea82918 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.945805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c78dd4-a3bc-4b99-a66c-d4901ea82918 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.948123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 459/927] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:09.954270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a945c-b066-45f6-8ae2-66df09d07d9d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:09.954270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a945c-b066-45f6-8ae2-66df09d07d9d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:09.954270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a945c-b066-45f6-8ae2-66df09d07d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:09.973294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e07a945c-b066-45f6-8ae2-66df09d07d9d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:09.974491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e07a945c-b066-45f6-8ae2-66df09d07d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:10.039969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:10.060606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:10.068257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 460/928] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:10.076058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888730d-7d33-4ab2-aa6e-62a37ddad5e3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.112757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.113670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.114137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.114583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.115367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:10.116910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:10.123813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 469/929] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:11:09 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:11:10.222003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a945c-b066-45f6-8ae2-66df09d07d9d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.335414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a945c-b066-45f6-8ae2-66df09d07d9d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.366372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.373110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.373917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.374194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.374466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.375061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:10.376513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:10.385454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:10.386417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:10.387317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 461/930] 10.222.0.86 () {56 vars in 1132 bytes} [Thu Aug 18 11:11:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:10.393402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.460619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:10.480546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463be05-2950-4bac-8378-92f957738a1d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.504821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f761c-855e-4dd3-b7ae-649c50c45846 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.518009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.518950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.519340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.520133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.534267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:10.540679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:10.540865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:10.541926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:10.542963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:10.544354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.544354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.544354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.552236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:10.552236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:10.552236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:10.552688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 470/931] 10.222.0.86 () {56 vars in 1120 bytes} [Thu Aug 18 11:11:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:10.552688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.555498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:10.560100 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 462/932] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:10.561473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.665441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a136-ef60-4798-957d-bb3673fa7b8e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.671919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efd0cb-34e2-4a45-bc1e-38ece9a0a188 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.705466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:10.707512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.708128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.708459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.708724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.709393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:10.709702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:10.711167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:10.717179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.723360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.723360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.723360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.723360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:10.723360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:10.723360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:10.724580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 471/933] 10.222.0.86 () {56 vars in 1115 bytes} [Thu Aug 18 11:11:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:10.725458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.733294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 463/934] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:10.734685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.812639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:10.830801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62961-c9fe-4ae7-97dc-34242b995b49 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.842885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f1f19-e687-4e22-975b-7d7581bc21a8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:10.867013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.867696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.868069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.868292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.880058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:10.881594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:10.882593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:10.883441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:10.883923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:10.884575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:10.885517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:10.887067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:10.898003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:10.899122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:10.900072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:10.900072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:10.900072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:10.904289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 472/935] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:10.905160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:10.967504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 464/936] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:11:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:11:11.016269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160465b3-b85b-4940-883c-82e7ac32c5d6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:11.034765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:11.061396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:11.062021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.062331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.062611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.063271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:11.063577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:11.064994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:11.079450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 473/937] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:11.085981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:11.139201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:11.197792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234c1f7-2cfd-409c-9c81-87c0b03483d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:11.235998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:11.236599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.236931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.237213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.245364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:11.246860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:11.258753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:11.259945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:11.261028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 465/938] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:11:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:11.268375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:11.375888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75963d-5965-4c8e-9c8d-8549ffc16eea None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:11.412499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:11.413495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.414015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.414515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.415453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:11.416024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:11.417682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:11.435628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 474/939] 10.222.0.86 () {56 vars in 1149 bytes} [Thu Aug 18 11:11:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:11.441558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:11.555267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543615-a31b-4e07-b220-c7da01e277cb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:11.564242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:11.593056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:11.594031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.594474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.594897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.606770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:11.608512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:11.623966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:11.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:11.626269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:11.626269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:11.626269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:11.627964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 466/940] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:11.633633 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:11.665839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:11.740696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c73a-d262-4d84-8023-bd2335f12d2f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:11.776776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be963b-f456-4a9a-ad6f-f087e54ccfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:11.777386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be963b-f456-4a9a-ad6f-f087e54ccfaf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.777672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be963b-f456-4a9a-ad6f-f087e54ccfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.777949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be963b-f456-4a9a-ad6f-f087e54ccfaf None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.778792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be963b-f456-4a9a-ad6f-f087e54ccfaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:11.779102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be963b-f456-4a9a-ad6f-f087e54ccfaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:11.780567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be963b-f456-4a9a-ad6f-f087e54ccfaf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:11.793119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 475/941] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:11.798839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:11.856696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb1f0-6c1b-4869-9404-c4e29f9429ad None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.857330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb1f0-6c1b-4869-9404-c4e29f9429ad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.857889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cb1f0-6c1b-4869-9404-c4e29f9429ad None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.859830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 476/942] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:11.864766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943fcd6-48c6-493f-944a-0ccfa1b690d2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.865050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943fcd6-48c6-493f-944a-0ccfa1b690d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.865322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943fcd6-48c6-493f-944a-0ccfa1b690d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.884256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4943fcd6-48c6-493f-944a-0ccfa1b690d2 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:11.885453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4943fcd6-48c6-493f-944a-0ccfa1b690d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:11.919428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfdfa2-c973-47bb-b60d-3fa1bebdfa74 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:11.956456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:11.957186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:11.957469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:11.957744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:11.965079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:11.966962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:11.968579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 477/943] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:11.978521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:11.979434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:11.980446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 467/944] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:11.987865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943fcd6-48c6-493f-944a-0ccfa1b690d2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:12.010446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.093832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943fcd6-48c6-493f-944a-0ccfa1b690d2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:12.130205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:12.130729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.131007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.131281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.131969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:12.132298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:12.133721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:12.146109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 478/945] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:12.152044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:12.177793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.249070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:12.276000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c3898-345b-4fcc-a243-f5846aecd940 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:12.313193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b976ec-b70b-47d3-b094-9ef8c19bffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:12.313922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b976ec-b70b-47d3-b094-9ef8c19bffa1 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.314131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b976ec-b70b-47d3-b094-9ef8c19bffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.314408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b976ec-b70b-47d3-b094-9ef8c19bffa1 None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/5409b17aa2224f0fa60de95d5fc2e892/roles/d2766df682dc448ca6aff60f115c96c1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.316581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b976ec-b70b-47d3-b094-9ef8c19bffa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=5409b17aa2224f0fa60de95d5fc2e892, role_id=d2766df682dc448ca6aff60f115c96c1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:12.318087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b976ec-b70b-47d3-b094-9ef8c19bffa1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:12.336052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.354952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37381e-5176-42b5-9cb9-9c5ff16c6e22 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:12.386071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 468/946] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:11:12 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/5409b17aa2224f0fa60de95d5fc2e892/roles/d2766df682dc448ca6aff60f115c96c1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:11:12.387567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841fa79-ed11-43f7-bc20-21ab4f69ab73 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.387869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841fa79-ed11-43f7-bc20-21ab4f69ab73 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.388135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841fa79-ed11-43f7-bc20-21ab4f69ab73 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.389632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 469/947] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:12.395128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7412e-8212-4247-a221-66126f43b813 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.395444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7412e-8212-4247-a221-66126f43b813 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.395737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7412e-8212-4247-a221-66126f43b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.411011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:12.412634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.415637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.415637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.415637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:12.415889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:12.417188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-82b7412e-8212-4247-a221-66126f43b813 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:12.418563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING keystone.server.flask.common [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 11:11:12.419610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-82b7412e-8212-4247-a221-66126f43b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:12.483040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.sql.core [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 11:11:12.483040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 11:11:12.483040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [parameters: {'id': '02118603321d44a1a810f75488aa0ef5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 11:11:12.483040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81583) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 11:11:12.504741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 470/948] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02118603321d44a1a810f75488aa0ef5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02118603321d44a1a810f75488aa0ef5. Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:11:12.505813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 11:11:12.506627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application yield resource Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise self.value Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application session.commit() Aug 18 11:11:12.507578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.flush() Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application compat.raise_( Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 11:11:12.508516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 11:11:12.509416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:11:12.510213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [parameters: {'id': '02118603321d44a1a810f75488aa0ef5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:12.511063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:12.511873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02118603321d44a1a810f75488aa0ef5. Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:12.513255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 479/949] 10.222.0.86 () {60 vars in 1140 bytes} [Thu Aug 18 11:11:12 2022] POST /identity/v3/projects => generated 262 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:12.515694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7412e-8212-4247-a221-66126f43b813 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:12.526773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.627880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7412e-8212-4247-a221-66126f43b813 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:12.664502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:12.665059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.665338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.665612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.677299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:12.677299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:12.690618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:12.691511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:12.692826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:12.694869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 471/950] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:12.701431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:12.792711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:12.814467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bc6d-48f8-4c46-b7f9-6bbf7ffae348 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:12.851273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:12.856784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.856784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.856784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.856784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:12.856784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:12.856784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:12.859163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.880631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:12.882111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 480/951] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:11:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:12.907409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a424d-72d5-45c5-a8d6-f9065dd92c5e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:12.947946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a4fdd-e8b7-4296-bf0e-bffdd4d4b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:12.948559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4fdd-e8b7-4296-bf0e-bffdd4d4b42c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:12.948888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4fdd-e8b7-4296-bf0e-bffdd4d4b42c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:12.949169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4fdd-e8b7-4296-bf0e-bffdd4d4b42c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:12.949776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a4fdd-e8b7-4296-bf0e-bffdd4d4b42c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:12.951826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a4fdd-e8b7-4296-bf0e-bffdd4d4b42c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9c6a4fdd-e8b7-4296-bf0e-bffdd4d4b42c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:12.962752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:12.967673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:12.968592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 472/952] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:12.971169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:13.050634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b90a1-8e7c-4850-a53f-4ab4c27db447 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.050970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b90a1-8e7c-4850-a53f-4ab4c27db447 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.051197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b90a1-8e7c-4850-a53f-4ab4c27db447 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.053714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 473/953] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:13.062735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b558479-48af-4579-961f-53cae061d7c5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.062735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b558479-48af-4579-961f-53cae061d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.062735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b558479-48af-4579-961f-53cae061d7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.082552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0b558479-48af-4579-961f-53cae061d7c5 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:13.083748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b558479-48af-4579-961f-53cae061d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:13.087230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f3764-2e0f-4ce9-8760-8c6bde181be6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:13.134713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:13.135886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.135886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.135886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.136547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:13.138675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:13.138785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:13.143943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 481/954] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:13.151341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:13.182446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 474/955] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:13.249267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:13.280503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def2ca8-a49e-40e9-a56c-31cdf04bb85c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:13.316788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:13.317398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.317680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.317960 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.318588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:13.318954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:13.320332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:13.325908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 482/956] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:13.331527 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b558479-48af-4579-961f-53cae061d7c5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:13.398375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:13.439745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b558479-48af-4579-961f-53cae061d7c5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:13.478081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:13.478656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.478984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.479225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.479990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:13.481444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:13.481575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:13.582957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 475/957] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:11:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:13.592126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60285-108d-4bcb-9d0e-8a366f235aff None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:13.619661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:13.639553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:13.640232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.640520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.640798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.641393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:13.642773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:13.652746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:13.654880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:13.655945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 483/958] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:13.664809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:13.780084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65512daf-13b7-4a70-b49b-0b4eae7115d5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:13.798966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:13.816434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ea8d8-8f8f-4b8e-8936-59c64f1f3709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:13.819214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea8d8-8f8f-4b8e-8936-59c64f1f3709 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.819214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea8d8-8f8f-4b8e-8936-59c64f1f3709 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.819214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea8d8-8f8f-4b8e-8936-59c64f1f3709 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.819214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ea8d8-8f8f-4b8e-8936-59c64f1f3709 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:13.819214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ea8d8-8f8f-4b8e-8936-59c64f1f3709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:13.819889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ea8d8-8f8f-4b8e-8936-59c64f1f3709 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:13.830034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 476/959] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:11:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:13.831794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:13.939420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc78f75-646a-4a5f-ad91-4aaf4923b766 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:13.975638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b2a3b-5f5d-4cd8-9c7f-d3d39a2eaeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:13.976632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2a3b-5f5d-4cd8-9c7f-d3d39a2eaeac None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:13.977079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2a3b-5f5d-4cd8-9c7f-d3d39a2eaeac None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:13.977501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2a3b-5f5d-4cd8-9c7f-d3d39a2eaeac None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:13.978282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b2a3b-5f5d-4cd8-9c7f-d3d39a2eaeac None admin] RBAC: Adding query filter params (type=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:13.978734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b2a3b-5f5d-4cd8-9c7f-d3d39a2eaeac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:13.980254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b2a3b-5f5d-4cd8-9c7f-d3d39a2eaeac None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:13.992349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 484/960] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:11:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:14.400081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03a69c-0668-4e5b-b7e5-dee089f241c7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:14.400479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03a69c-0668-4e5b-b7e5-dee089f241c7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:14.400689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03a69c-0668-4e5b-b7e5-dee089f241c7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:14.402150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 477/961] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:14.407648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b4f99-ccdd-4d66-8e79-72412ae9e0dc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:14.407938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b4f99-ccdd-4d66-8e79-72412ae9e0dc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:14.408242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b4f99-ccdd-4d66-8e79-72412ae9e0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:14.430491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-903b4f99-ccdd-4d66-8e79-72412ae9e0dc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:14.432439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-903b4f99-ccdd-4d66-8e79-72412ae9e0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:14.482489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:14.507027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 485/962] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:14.782565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03a69c-0668-4e5b-b7e5-dee089f241c7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:14.896594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03a69c-0668-4e5b-b7e5-dee089f241c7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:14.932888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0b12d-f204-4733-baa7-6b819015de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:14.933533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0b12d-f204-4733-baa7-6b819015de07 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:14.933818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0b12d-f204-4733-baa7-6b819015de07 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:14.934121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0b12d-f204-4733-baa7-6b819015de07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:14.946653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0b12d-f204-4733-baa7-6b819015de07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d5e0b12d-f204-4733-baa7-6b819015de07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:14.951814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:14.952827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:14.953791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 478/963] 10.222.0.86 () {56 vars in 1120 bytes} [Thu Aug 18 11:11:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:14.960946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b4f99-ccdd-4d66-8e79-72412ae9e0dc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.031567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b082ba-9af2-4827-b344-73e1f07c4b30 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.031879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b082ba-9af2-4827-b344-73e1f07c4b30 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.032119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b082ba-9af2-4827-b344-73e1f07c4b30 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.034019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 479/964] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:15.039189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ed89-2f3e-45c7-8c6c-82b655c7c3d0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.039624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ed89-2f3e-45c7-8c6c-82b655c7c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.039907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ed89-2f3e-45c7-8c6c-82b655c7c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.061266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-aee2ed89-2f3e-45c7-8c6c-82b655c7c3d0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:15.062881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aee2ed89-2f3e-45c7-8c6c-82b655c7c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:15.069622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b4f99-ccdd-4d66-8e79-72412ae9e0dc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:15.100912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:15.109031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:15.109660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.109946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.110223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.110918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:15.111224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:15.112657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:15.122653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 486/965] 10.222.0.86 () {56 vars in 1115 bytes} [Thu Aug 18 11:11:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:15.127552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.147769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 480/966] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:15.174775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:15.237222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262877e-d132-4776-a582-65fded41d7c9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:15.276290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:15.277285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.277763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.278863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.290240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:15.291948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:15.307101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:15.308047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:15.308955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:15.308955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:15.308955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:15.311468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 487/967] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:15.316972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ed89-2f3e-45c7-8c6c-82b655c7c3d0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.423938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ed89-2f3e-45c7-8c6c-82b655c7c3d0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:15.454603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.459889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:15.460551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.460831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.461102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.461754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:15.462054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:15.463421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:15.476938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 481/968] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:15.485263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.523491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:15.576693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:15.581710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c791f7-6166-47c7-b5c1-1f5de3d0f4e2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:15.614150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25323-7240-48c9-9079-1fad07839b7b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:15.626188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:15.627451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.628254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.628819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.629897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:15.632110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:15.654068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8873ac-2dc7-4bfa-b544-889805b2af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:15.654698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8873ac-2dc7-4bfa-b544-889805b2af04 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.654984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8873ac-2dc7-4bfa-b544-889805b2af04 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.655260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8873ac-2dc7-4bfa-b544-889805b2af04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.663061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8873ac-2dc7-4bfa-b544-889805b2af04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:15.664526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8873ac-2dc7-4bfa-b544-889805b2af04 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:15.675101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.sql.core [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 11:11:15.675101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 11:11:15.675101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [parameters: {'user_id': '4b9c9ce9a234481c8550365174422f85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 11:11:15.675101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81583) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1a8873ac-2dc7-4bfa-b544-889805b2af04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:15.675804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:15.676760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 11:11:15.677711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:15.681737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 482/969] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:11:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-92b732e0-6eec-4179-b2e8-68266b611270 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 18 11:11:15.682398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 11:11:15.684787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application yield resource Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise self.value Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application session.commit() Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 11:11:15.690920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.flush() Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application compat.raise_( Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 11:11:15.691818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:11:15.692727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:11:15.693581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [parameters: {'user_id': '4b9c9ce9a234481c8550365174422f85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:15.694482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 11:11:15.695271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 11:11:15.696171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 11:11:15.696171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 11:11:15.696171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 11:11:15.696171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 11:11:15.696171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 11:11:15.696171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:15.698406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c13e-6f35-4e5b-926c-bdb579c6de4d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.698406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c13e-6f35-4e5b-926c-bdb579c6de4d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.698406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c13e-6f35-4e5b-926c-bdb579c6de4d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.698406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 483/970] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:15.698406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c13e-6f35-4e5b-926c-bdb579c6de4d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.699162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 488/971] 10.222.0.86 () {60 vars in 1131 bytes} [Thu Aug 18 11:11:15 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:15.699162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e36bc-a90c-4864-b28d-277e109b2062 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.699162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e36bc-a90c-4864-b28d-277e109b2062 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.699162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e36bc-a90c-4864-b28d-277e109b2062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.713792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c28e36bc-a90c-4864-b28d-277e109b2062 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:15.715358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c28e36bc-a90c-4864-b28d-277e109b2062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:15.788256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 489/972] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:15.788256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e36bc-a90c-4864-b28d-277e109b2062 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.802907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:15.818177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c13e-6f35-4e5b-926c-bdb579c6de4d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:15.865801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:15.866621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.866959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.867242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.867989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:15.868575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:15.870957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:15.892508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:15.898552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 484/973] 10.222.0.86 () {56 vars in 1149 bytes} [Thu Aug 18 11:11:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:15.899632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:15.912732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e36bc-a90c-4864-b28d-277e109b2062 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:15.960264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945bd72-1ffb-414a-8e5c-ef59480a21ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:15.961081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945bd72-1ffb-414a-8e5c-ef59480a21ed None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.961630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945bd72-1ffb-414a-8e5c-ef59480a21ed None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.961630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945bd72-1ffb-414a-8e5c-ef59480a21ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.969934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945bd72-1ffb-414a-8e5c-ef59480a21ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:15.971793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945bd72-1ffb-414a-8e5c-ef59480a21ed None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3945bd72-1ffb-414a-8e5c-ef59480a21ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:15.984489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:15.985448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:15.986395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 490/974] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:11:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:15.987015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e923a23-3b79-4e6b-807a-947091c44232 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:15.987015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e923a23-3b79-4e6b-807a-947091c44232 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:15.987654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e923a23-3b79-4e6b-807a-947091c44232 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:15.991458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 491/975] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:15.992175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e923a23-3b79-4e6b-807a-947091c44232 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.016053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad068f-797a-4082-99b3-6976a1070da1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.053968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.054579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.054860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.055388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.075635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.103093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e923a23-3b79-4e6b-807a-947091c44232 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.123557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.124962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.136991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667ee77-6798-436d-94b2-193d59536bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.138246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ee77-6798-436d-94b2-193d59536bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.138450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ee77-6798-436d-94b2-193d59536bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.138731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ee77-6798-436d-94b2-193d59536bd6 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.139427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ee77-6798-436d-94b2-193d59536bd6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:16.139732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ee77-6798-436d-94b2-193d59536bd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.141183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ee77-6798-436d-94b2-193d59536bd6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.175219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 492/976] 10.222.0.86 () {56 vars in 1101 bytes} [Thu Aug 18 11:11:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:16.176597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afaa39-1514-4c85-baa7-42657203c8d3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.176881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afaa39-1514-4c85-baa7-42657203c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.177164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afaa39-1514-4c85-baa7-42657203c8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.183661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.198323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f0afaa39-1514-4c85-baa7-42657203c8d3 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:16.199613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0afaa39-1514-4c85-baa7-42657203c8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:16.242793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 485/977] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:11:16.242793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.289728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 493/978] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:16.290695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afaa39-1514-4c85-baa7-42657203c8d3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.298905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.370048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58a1ef-6ea7-4dec-a89e-0f200d2a21e2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.418684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.419326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.419679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.420048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.420712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.421269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afaa39-1514-4c85-baa7-42657203c8d3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.422079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:16.433016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:16.434107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:16.434980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:16.436332 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 486/979] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:16.441194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.466356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.473328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.473328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.473328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.473695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.489946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.490732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:16.509516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:16.510938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:16.511927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:16.511927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:16.511927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:16.511927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 494/980] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:16.519098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.562520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11233f-e0fd-42d0-b2fa-3a4ad86fb70d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.578164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.598146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.598754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.599034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.599305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.599932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:16.600254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.601737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.606429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 487/981] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:16.607162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.626502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a44e0a-a7f2-4034-a742-9e742f341d72 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.662641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.663236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.663514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.663784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.664726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:16.664726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.666080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.677828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 495/982] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:16.678547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.708516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f62e1-a48d-4b88-a1c4-e5e6aece61bb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.722920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.742348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.742956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.743239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.743516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.744162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.745581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.777277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b78a-6afe-41b6-8146-a5ee7c31417e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.808361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 488/983] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:11:16 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:16.809488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.819455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.820111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.820441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.820723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.821377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:16.821685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.823104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.829032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 496/984] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:16.835527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:16.874809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.943113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5c6a-3d44-4bfc-8888-2aa1eb68ce73 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.953542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eda5f-5d87-4536-b81a-e19486c35fab None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:16.956792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:16.982831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.983479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.983905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.984170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.992790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.994228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:16.995540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:16.996718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:16.996718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:16.997079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:16.997763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] RBAC: Adding query filter params (interface=admin, service_id=ed2801d3adf74cf1b9e1ed09678fda16, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:16.998077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:16.999419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:17.004908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 497/985] 10.222.0.86 () {56 vars in 1249 bytes} [Thu Aug 18 11:11:16 2022] GET /identity/v3/endpoints?service_id=ed2801d3adf74cf1b9e1ed09678fda16&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:17.006137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:17.007031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:17.007946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 489/986] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:17.013020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:17.013255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:17.116228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:17.119467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec53d39-7932-4391-ae5c-c9df420a6b6a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:17.120620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c894a8-e9e6-4522-a597-73e911560f52 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:17.157116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade484ea-6739-4db8-93c1-1bc7f308c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:17.157482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:17.157734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade484ea-6739-4db8-93c1-1bc7f308c74e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:17.158001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:17.158100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade484ea-6739-4db8-93c1-1bc7f308c74e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:17.158284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade484ea-6739-4db8-93c1-1bc7f308c74e None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:17.158386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:17.158556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:17.159042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade484ea-6739-4db8-93c1-1bc7f308c74e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:17.159160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:17.159356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade484ea-6739-4db8-93c1-1bc7f308c74e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:17.160554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:17.160805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade484ea-6739-4db8-93c1-1bc7f308c74e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:17.167304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 490/987] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:11:17 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:11:17.179332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 498/988] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:17.186190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:17.309251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda6c32-22a0-4bd4-9603-186fdf4d877c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:17.347887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b30f08-11d6-44e7-b0f2-47571bcd50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:17.348545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30f08-11d6-44e7-b0f2-47571bcd50fc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:17.348830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30f08-11d6-44e7-b0f2-47571bcd50fc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:17.349105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30f08-11d6-44e7-b0f2-47571bcd50fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:17.349842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b30f08-11d6-44e7-b0f2-47571bcd50fc None admin] RBAC: Adding query filter params (role.id=d2766df682dc448ca6aff60f115c96c1, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=5409b17aa2224f0fa60de95d5fc2e892) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:17.350156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b30f08-11d6-44e7-b0f2-47571bcd50fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:17.351585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b30f08-11d6-44e7-b0f2-47571bcd50fc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:17.364298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 491/989] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:17 2022] GET /identity/v3/role_assignments?user.id=5409b17aa2224f0fa60de95d5fc2e892&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=d2766df682dc448ca6aff60f115c96c1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:18.754445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77059e7-0230-4a4d-85f6-a972f4ae12c2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:18.754968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77059e7-0230-4a4d-85f6-a972f4ae12c2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:18.754968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77059e7-0230-4a4d-85f6-a972f4ae12c2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:18.756388 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 499/990] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:18.761447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e66865-7c8a-4927-8552-422b6a828d5b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:18.761860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e66865-7c8a-4927-8552-422b6a828d5b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:18.762051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e66865-7c8a-4927-8552-422b6a828d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:18.780695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-22e66865-7c8a-4927-8552-422b6a828d5b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:18.781889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-22e66865-7c8a-4927-8552-422b6a828d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:18.803740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:18.851504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 492/991] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:19.083876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62383-49a8-4ae3-907d-98232ec51b5d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.084198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62383-49a8-4ae3-907d-98232ec51b5d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.084481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b62383-49a8-4ae3-907d-98232ec51b5d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.085965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 500/992] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:19.090943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ea30-2163-42a6-b7b3-521213961267 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.091229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ea30-2163-42a6-b7b3-521213961267 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.091502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ea30-2163-42a6-b7b3-521213961267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.109282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-edc4ea30-2163-42a6-b7b3-521213961267 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:19.110458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-edc4ea30-2163-42a6-b7b3-521213961267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:19.125140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62383-49a8-4ae3-907d-98232ec51b5d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.156105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:19.181747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 493/993] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:19.237988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b62383-49a8-4ae3-907d-98232ec51b5d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.272817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.273442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.273732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.274007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.274589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.275939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:19.284603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:19.285623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:19.286557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 501/994] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:19.289679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2b89-2a80-478c-a571-d55709c61673 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.289979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2b89-2a80-478c-a571-d55709c61673 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.290271 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2b89-2a80-478c-a571-d55709c61673 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.291593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 494/995] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:19.291903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.296759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8a92b-562c-4a34-82d9-1315a0dfc4aa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.297306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8a92b-562c-4a34-82d9-1315a0dfc4aa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.297800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8a92b-562c-4a34-82d9-1315a0dfc4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.315846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9ec8a92b-562c-4a34-82d9-1315a0dfc4aa None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:19.317093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9ec8a92b-562c-4a34-82d9-1315a0dfc4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:19.384408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 495/996] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:19.389094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:19.398752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b6fb7-8148-433c-ae35-dbf3817b9172 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.435013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.435625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.435910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.436186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.436853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:19.437159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.438520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.448038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 502/997] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:19.449145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8a92b-562c-4a34-82d9-1315a0dfc4aa None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.452050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.467719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:19.556059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8a92b-562c-4a34-82d9-1315a0dfc4aa None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.557620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68d352-e86b-49ff-9faa-fc4f8ede2f46 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.591315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.591922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.592226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.592509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.593173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:19.593455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.594634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.594817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.595562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.596002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.596316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.596976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.598319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.605178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 496/998] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:19.606389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:19.612289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:19.613281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 11:11:19.614144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:19.618324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 503/999] 10.222.0.86 () {56 vars in 1126 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:19.619024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.641516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:19.690862 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:19.710095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc154070-8fdb-4ca3-8449-831675e7e3d6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.720057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978c0b-04cc-4a45-a2c1-239b099c9316 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.744011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.744642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.744923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.745196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.745888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] RBAC: Adding query filter params (interface=public, service_id=494215206771457c9886345c290f1971, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:19.746192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.747886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.752795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 497/1000] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/endpoints?service_id=494215206771457c9886345c290f1971&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:19.753558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.754324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.754932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.755457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.755457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.756102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:19.756442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.757788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.763067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 504/1001] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:19.763845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.848056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:19.859632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b37e4-14e5-4399-9584-bd2cd15b664f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.863515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdcf1d-79c2-4661-95a5-284bcecc4b51 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:19.895406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.895957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.896257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.896533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.897112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.898458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.900563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:19.901169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:19.901446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:19.901720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:19.902322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:19.904064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:19.907578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:19.908751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:19.909631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 498/1002] 10.222.0.86 () {56 vars in 1105 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:19.910435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.910507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 505/1003] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:11:19.915173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:19.926549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:20.032323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370ca09-3a40-44c1-a828-cb82b3608985 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:20.033680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f49c-ca3b-47c8-bda0-00bf1dedf350 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:20.075847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:20.076134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:20.076398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:20.076794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:20.077065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:20.077216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:20.077517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:20.077709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:20.077971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:20.078087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:20.078784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] RBAC: Adding query filter params (name=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:20.079167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:20.079364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:20.080740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:20.086277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 499/1004] 10.222.0.86 () {56 vars in 1122 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:20.087104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 506/1005] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:20.092651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:20.092793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:20.109618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:20.171925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:20.207548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d18b25-a1c8-4dd7-8f50-edc3a88cac5f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:20.209633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a0b2f-add5-449d-bb5b-ebdfe7a1d853 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:20.248552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9e6ee-f91a-49c8-b235-23117bb9f3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:20.249170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9e6ee-f91a-49c8-b235-23117bb9f3ed None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:20.249455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9e6ee-f91a-49c8-b235-23117bb9f3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:20.249732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9e6ee-f91a-49c8-b235-23117bb9f3ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:20.250398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759818d-9cb9-473d-a032-652691803ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:20.250510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9e6ee-f91a-49c8-b235-23117bb9f3ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:20.251085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759818d-9cb9-473d-a032-652691803ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:20.251432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759818d-9cb9-473d-a032-652691803ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:20.251764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9e6ee-f91a-49c8-b235-23117bb9f3ed None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:20.251856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759818d-9cb9-473d-a032-652691803ed3 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:20.252507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759818d-9cb9-473d-a032-652691803ed3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:20.252874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759818d-9cb9-473d-a032-652691803ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:20.254556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759818d-9cb9-473d-a032-652691803ed3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:20.259680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 507/1006] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:20.312670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 500/1007] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:11:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:21.853325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93fe9-cfb5-4e36-afe1-a79367d4f4ce None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:21.853853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93fe9-cfb5-4e36-afe1-a79367d4f4ce None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:21.853853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93fe9-cfb5-4e36-afe1-a79367d4f4ce None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:21.855486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 508/1008] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:21.861770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafdece-a595-4667-824a-7e553f077e93 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:21.862179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafdece-a595-4667-824a-7e553f077e93 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:21.862394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafdece-a595-4667-824a-7e553f077e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:21.927660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-afafdece-a595-4667-824a-7e553f077e93 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:21.928895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-afafdece-a595-4667-824a-7e553f077e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:22.005006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 501/1009] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:22.165489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f350-0885-432b-ab8a-41214775859c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.165674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f350-0885-432b-ab8a-41214775859c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.165957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57f350-0885-432b-ab8a-41214775859c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.167461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 509/1010] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:22.173228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f68af-bcb3-41b2-a862-520477eac1ea None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.173520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f68af-bcb3-41b2-a862-520477eac1ea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.173797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f68af-bcb3-41b2-a862-520477eac1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.192388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-794f68af-bcb3-41b2-a862-520477eac1ea None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:22.193554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-794f68af-bcb3-41b2-a862-520477eac1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:22.230035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e567d-94da-4b9f-beac-aefd443fe275 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.230314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e567d-94da-4b9f-beac-aefd443fe275 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.230653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e567d-94da-4b9f-beac-aefd443fe275 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.232674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 510/1011] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:22.237279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad13a49-bdd7-4ff5-b7de-c095ee552fe9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.237568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad13a49-bdd7-4ff5-b7de-c095ee552fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.238588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad13a49-bdd7-4ff5-b7de-c095ee552fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.255882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-dad13a49-bdd7-4ff5-b7de-c095ee552fe9 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:22.256742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:22.258735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dad13a49-bdd7-4ff5-b7de-c095ee552fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:22.270264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 502/1012] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:22.280973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f68af-bcb3-41b2-a862-520477eac1ea None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:22.336232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 511/1013] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:22.390051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f68af-bcb3-41b2-a862-520477eac1ea None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:22.426181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:22.427073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.427540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.427995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.428815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:22.430376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:22.439306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:22.440347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 11:11:22.441246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:22.444752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 503/1014] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:22.447534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad13a49-bdd7-4ff5-b7de-c095ee552fe9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:22.457216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:22.542763 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:22.551933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad13a49-bdd7-4ff5-b7de-c095ee552fe9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:22.588827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:22.589554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.589836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.590840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.591482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:22.591793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:22.593398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:22.596611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:22.603867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 512/1015] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:11:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:22.604983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:22.644613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e428b27-beb5-4a67-b72c-3017cb96f4fd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:22.674463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:22.679077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:22.679630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.679908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.680188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.683940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:22.683940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:22.705566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98393c9-187e-4b50-a6b7-f99ea28177b7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:22.739093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:22.739688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.739967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.740280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.740903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:22.741238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:22.742592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:22.747310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 513/1016] 10.222.0.86 () {56 vars in 1112 bytes} [Thu Aug 18 11:11:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:22.748308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:22.755851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 504/1017] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:11:22 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:22.756906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:22.867103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71e58-c20f-42ca-acff-32965b99e160 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:22.882201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56761921-6909-4296-88ca-fb9c717f54b7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:22.893195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:22.913697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:22.914335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.914616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.914889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.916002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:22.917475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:22.919945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 514/1018] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:22.923372 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2f4dc-82e6-4481-856c-78e3ff3a2b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:22.923988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2f4dc-82e6-4481-856c-78e3ff3a2b5a None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:22.924301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2f4dc-82e6-4481-856c-78e3ff3a2b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:22.924907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2f4dc-82e6-4481-856c-78e3ff3a2b5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:22.925584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2f4dc-82e6-4481-856c-78e3ff3a2b5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:22.925704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:22.926959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2f4dc-82e6-4481-856c-78e3ff3a2b5a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:22.929245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:23.032463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f0a5d-a3ef-4bcf-a3f9-a83f8fd8fe68 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:23.066856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42235c68-6dd7-4d8a-913b-ba0bcbdda5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:23.067458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235c68-6dd7-4d8a-913b-ba0bcbdda5cb None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:23.067744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235c68-6dd7-4d8a-913b-ba0bcbdda5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:23.068024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42235c68-6dd7-4d8a-913b-ba0bcbdda5cb None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:23.068699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42235c68-6dd7-4d8a-913b-ba0bcbdda5cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:23.070155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42235c68-6dd7-4d8a-913b-ba0bcbdda5cb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:23.084607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 505/1019] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:11:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:23.159468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 515/1020] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:11:22 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:11:24.697289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac35f-5772-4a87-a511-9cd1a1258c1e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:24.697822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac35f-5772-4a87-a511-9cd1a1258c1e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:24.697822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac35f-5772-4a87-a511-9cd1a1258c1e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:24.699393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 506/1021] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:24.704835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d7c19-62bd-4acd-ae8c-a88b120e0e42 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:24.705254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d7c19-62bd-4acd-ae8c-a88b120e0e42 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:24.705419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d7c19-62bd-4acd-ae8c-a88b120e0e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:24.723741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5b9d7c19-62bd-4acd-ae8c-a88b120e0e42 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:24.725054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5b9d7c19-62bd-4acd-ae8c-a88b120e0e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:24.776764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:24.800877 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 516/1022] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:25.071389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ac35f-5772-4a87-a511-9cd1a1258c1e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.097604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c3590-b682-47bf-99c7-23583282dd14 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.097819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c3590-b682-47bf-99c7-23583282dd14 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.098121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c3590-b682-47bf-99c7-23583282dd14 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.099366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 517/1023] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:25.104179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81d09-75b6-4b08-b60c-be55a1079a8f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.104495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81d09-75b6-4b08-b60c-be55a1079a8f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.104776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81d09-75b6-4b08-b60c-be55a1079a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.124122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9ab81d09-75b6-4b08-b60c-be55a1079a8f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:25.125361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9ab81d09-75b6-4b08-b60c-be55a1079a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:25.184031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ac35f-5772-4a87-a511-9cd1a1258c1e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.192616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 518/1024] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:25.193984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de8ce2-f527-4558-b453-6f1433e19551 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.194273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de8ce2-f527-4558-b453-6f1433e19551 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.194551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de8ce2-f527-4558-b453-6f1433e19551 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.195777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 519/1025] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:25.202129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c95ba7-3ca9-49d7-8629-53696941cb29 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.202418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c95ba7-3ca9-49d7-8629-53696941cb29 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.202691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c95ba7-3ca9-49d7-8629-53696941cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.223498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.223498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.223498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.223498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.223916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:25.223916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:25.225068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-11c95ba7-3ca9-49d7-8629-53696941cb29 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:25.226450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-11c95ba7-3ca9-49d7-8629-53696941cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:25.233535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:25.234546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:25.236243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 507/1026] 10.222.0.86 () {56 vars in 1105 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:25.240395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.269056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:25.305276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 520/1027] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:25.344634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaccb7-7415-4928-be9c-f64a237d7ac2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.380089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.380730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.381015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.381290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.381924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:25.382229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:25.383599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:25.389408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 508/1028] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:25.395021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c95ba7-3ca9-49d7-8629-53696941cb29 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.438119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:25.467381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.498206 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c95ba7-3ca9-49d7-8629-53696941cb29 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.534183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.534892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.535240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.535598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.536334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] RBAC: Adding query filter params (type=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:25.536965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:25.538385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:25.548381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 521/1029] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:25.550476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.573833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:25.582725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29852b3a-5fcc-409c-abf7-49082adf14c1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.617966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.618525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.618808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.619084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.629432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:25.634166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:25.635314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 509/1030] 10.222.0.86 () {56 vars in 1120 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:25.636163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.660757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0604f7-1d27-4450-8991-477d552f7378 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.663377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:25.696446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.697147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.697508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.697859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.698628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] RBAC: Adding query filter params (interface=public, service_id=260e229c1d3d42c9ae9e7b538eada52e, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:25.699014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:25.700979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:25.706173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 522/1031] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/endpoints?service_id=260e229c1d3d42c9ae9e7b538eada52e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:25.706954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.740470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a10d9-7028-4f91-93db-63ce7696ef21 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.773546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.774175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.774458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.774734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.775863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:25.777954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:25.779519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 510/1032] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:25.780432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.802529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:25.809024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef852-6042-4bb6-995b-799f783f54df None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.843095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.843699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.843981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.844287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.844957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:25.850734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:25.850734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:25.854412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 523/1033] 10.222.0.86 () {56 vars in 1115 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:25.855170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.886632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:25.887625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9329b5d-a7eb-4681-8faa-22e491260925 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:25.921726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:25.922344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:25.922626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:25.922900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:25.923508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:25.924907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:25.931302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 511/1034] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:11:25.932077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:25.970254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938f0d6-b187-4244-967d-11d56a4c400b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:26.008687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:26.009324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:26.009606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:26.009881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:26.010545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:26.012766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:26.026667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:26.043981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfaa34-1b5e-48e0-916e-c03d3d669cc4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:26.079393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:26.080026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:26.080335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:26.080610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:26.091287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:26.092915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:26.106977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:26.109855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:26.110741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:26.110741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:26.110741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:26.110741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 512/1035] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:26.114053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:26.134187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 524/1036] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:11:25 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:26.235000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cb3fc-9484-4cbc-b776-fd50f3bcb96f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:26.275456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:26.276075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:26.276383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:26.276662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:26.277884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:26.278194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:26.279657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:26.282338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:26.293675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 513/1037] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:26.299238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:26.395845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:26.411078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176a4c-4253-4788-a6e6-a3c0b6f1c568 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:26.450070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:26.450763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:26.451046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:26.451322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:26.458617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:26.460631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:26.472932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:26.473894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:26.474846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 525/1038] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:11:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:26.479817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:26.583019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1dbc4-507e-420a-a3c4-90ddf41da358 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:26.617437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:26.618052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:26.618334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:26.618609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:26.619333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:26.619640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:26.621151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:26.638093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 514/1039] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:11:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:26.643688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:26.745590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec7e64-8536-4c88-b8c3-d23894ca3986 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:26.780736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:26.781338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:26.781620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:26.781890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:26.798828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:26.852013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:26.853518 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:26.956047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 526/1040] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 11:11:26.961751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:27.020054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:27.067070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba392cc0-e572-4f62-bfb4-ae5555f35c62 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:27.100820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:27.101450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:27.101730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:27.102001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:27.112519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:27.113985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:27.128562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:27.129672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:27.130579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:27.130579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:27.130579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:27.132620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 515/1041] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:27.135352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:27.184990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:27.249631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be028050-0b20-4228-8ab9-69377fa2a481 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:27.284341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:27.284951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:27.285238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:27.285517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:27.286167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:27.286474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:27.288083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:27.301096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 527/1042] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:27.307134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:27.408517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e01a4-3cf7-4616-b691-89c0cce6b230 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:27.415942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:27.443750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:27.444413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:27.444702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:27.444981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:27.452606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:27.454329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:27.465702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:27.466719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:27.472691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 516/1043] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:27.473429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:27.577291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7a1c0-f718-421d-8992-e0919f2be08c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:27.584781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:27.612103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98609907-395f-46e6-bfe0-cd873932cc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:27.612770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609907-395f-46e6-bfe0-cd873932cc64 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:27.613054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609907-395f-46e6-bfe0-cd873932cc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:27.613332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609907-395f-46e6-bfe0-cd873932cc64 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:27.614039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98609907-395f-46e6-bfe0-cd873932cc64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:27.614349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98609907-395f-46e6-bfe0-cd873932cc64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:27.615780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98609907-395f-46e6-bfe0-cd873932cc64 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:27.633833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 528/1044] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:27.635571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:27.740630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4924-762c-4305-96d9-6e7046e0ecb9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:27.775119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83c350-9e1e-4592-aabb-c965abd4eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:27.775732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c350-9e1e-4592-aabb-c965abd4eb09 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:27.776018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c350-9e1e-4592-aabb-c965abd4eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:27.776326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83c350-9e1e-4592-aabb-c965abd4eb09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:27.777060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83c350-9e1e-4592-aabb-c965abd4eb09 None admin] RBAC: Adding query filter params (role.id=d2766df682dc448ca6aff60f115c96c1, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=748eb93057e245c1b8183dbe0340fa3f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:27.777545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83c350-9e1e-4592-aabb-c965abd4eb09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:27.778971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83c350-9e1e-4592-aabb-c965abd4eb09 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:27.792294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 517/1045] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:27 2022] GET /identity/v3/role_assignments?user.id=748eb93057e245c1b8183dbe0340fa3f&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=d2766df682dc448ca6aff60f115c96c1 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:27.862092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e8c31-79b6-40dd-9fd7-db503899b519 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:27.862616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e8c31-79b6-40dd-9fd7-db503899b519 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:27.862616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e8c31-79b6-40dd-9fd7-db503899b519 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:27.864140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 529/1046] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:27.869710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4976d-b0b9-45f7-8203-816779360e06 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:27.869996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4976d-b0b9-45f7-8203-816779360e06 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:27.870277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4976d-b0b9-45f7-8203-816779360e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:27.891487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-64a4976d-b0b9-45f7-8203-816779360e06 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:27.892737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64a4976d-b0b9-45f7-8203-816779360e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:27.921454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:27.969088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 518/1047] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:28.184094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619af71-e8b1-4703-8d7d-c16b90d503e6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.184535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619af71-e8b1-4703-8d7d-c16b90d503e6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.184835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619af71-e8b1-4703-8d7d-c16b90d503e6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.186333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 530/1048] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:28.191231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562dbc1-089e-4cce-bba2-dede7363a586 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.191519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562dbc1-089e-4cce-bba2-dede7363a586 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.191795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562dbc1-089e-4cce-bba2-dede7363a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.213714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f562dbc1-089e-4cce-bba2-dede7363a586 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:28.215573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f562dbc1-089e-4cce-bba2-dede7363a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:28.238682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619af71-e8b1-4703-8d7d-c16b90d503e6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:28.286854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 519/1049] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:28.345445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619af71-e8b1-4703-8d7d-c16b90d503e6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:28.380877 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:28.381507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.381791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.382066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] PATH_INFO: `/v3/services/image` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.382652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:28.384006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:28.393448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:28.394458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:28.397283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 531/1050] 10.222.0.86 () {56 vars in 1105 bytes} [Thu Aug 18 11:11:28 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:28.400542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562dbc1-089e-4cce-bba2-dede7363a586 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:28.494438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:28.503909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562dbc1-089e-4cce-bba2-dede7363a586 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:28.539672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:28.540326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.540627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.540887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.541525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:28.541831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:28.543327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:28.553275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 520/1051] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:28.554306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:28.556526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:28.586061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:28.662111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da13a-2c66-485c-b9e6-bc7860702d18 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:28.665045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb576d-7cc2-4b06-b5ca-dc8164514541 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:28.698375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:28.699029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.699503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.699786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.700456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] RBAC: Adding query filter params (type=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:28.700765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:28.701864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:28.702127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:28.702490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.702768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.703039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.707260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 532/1052] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:28.712812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:28.713597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:28.718626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:28.719569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:28.720806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:28.724816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 521/1053] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:28.725621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:28.742972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:28.813450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:28.820380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963998-7f9f-441b-96ae-4b02ceff669a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:28.834280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890320-5acd-4587-b297-b2c0fdeec1ac None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:28.858905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:28.859982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.860513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.860975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.861865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:28.863345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:28.874056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:28.874573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:28.874948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:28.875140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:28.875818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:28.876126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:28.877575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:28.886278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 522/1054] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:28.891865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:28.947283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 533/1055] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:11:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:11:28.984714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:29.010854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890d65-765b-464a-8e16-8029e64902a5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:29.055302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:29.055994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:29.056323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:29.056600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] PATH_INFO: `/v3/users/183568f74a1f47608f04b3f0249dea6b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:29.072255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] RBAC: Authorizing `identity:get_user(user_id=183568f74a1f47608f04b3f0249dea6b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:29.073654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:29.080248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 523/1056] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:28 2022] GET /identity/v3/users/183568f74a1f47608f04b3f0249dea6b => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:29.082476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:29.187502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d6abd-c7b9-424f-821f-ecc3984735e4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:29.232897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:29.233856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:29.234370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:29.234867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:29.256124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:29.311362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:29.312906 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:29.419354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 534/1057] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 11:11:29.420541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:29.522917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2294a-1406-47da-b026-421f4bcb6647 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:29.552533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:29.559829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1376f3b-3e3c-4b49-af07-68eb18e8ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:29.560502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376f3b-3e3c-4b49-af07-68eb18e8ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:29.560787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376f3b-3e3c-4b49-af07-68eb18e8ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:29.567757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376f3b-3e3c-4b49-af07-68eb18e8ebf6 None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:29.567757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376f3b-3e3c-4b49-af07-68eb18e8ebf6 None admin] RBAC: Authorizing `identity:get_project(project_id=a93ce44fc5c2424681891c7353ed96f1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:29.567757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376f3b-3e3c-4b49-af07-68eb18e8ebf6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:29.567757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 524/1058] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:29 2022] GET /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:29.571228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:29.623584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:29.674001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70c2cb-73b2-4793-968d-934de418a910 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:29.705594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b5f2-acc5-4ed8-9bd8-e17f77580022 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:29.705904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b5f2-acc5-4ed8-9bd8-e17f77580022 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:29.706150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b5f2-acc5-4ed8-9bd8-e17f77580022 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:29.707686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 525/1059] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:29.708592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:29.709143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:29.709426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:29.709703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:29.710453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=a93ce44fc5c2424681891c7353ed96f1, user.id=183568f74a1f47608f04b3f0249dea6b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:29.710767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:29.712181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:29.712379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbadb2-53fa-45ff-8293-878d4ae1adf1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:29.712667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbadb2-53fa-45ff-8293-878d4ae1adf1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:29.712940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbadb2-53fa-45ff-8293-878d4ae1adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:29.718015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 535/1060] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:29 2022] GET /identity/v3/role_assignments?user.id=183568f74a1f47608f04b3f0249dea6b&scope.project.id=a93ce44fc5c2424681891c7353ed96f1&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:29.732164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c4fbadb2-53fa-45ff-8293-878d4ae1adf1 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:29.733431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c4fbadb2-53fa-45ff-8293-878d4ae1adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:29.808053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 526/1061] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:30.078939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:30.184096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153c5cd-0cfe-440b-9ded-a83ad7d144ee None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:30.197592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:30.220097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:30.223480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:30.223480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:30.223480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:30.235799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:30.240582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:30.241496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:30.242324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:30.244531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 536/1062] 10.222.0.86 () {56 vars in 1120 bytes} [Thu Aug 18 11:11:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:30.248549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbadb2-53fa-45ff-8293-878d4ae1adf1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:30.347919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbadb2-53fa-45ff-8293-878d4ae1adf1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:30.374583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:30.382784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:30.383446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:30.383724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:30.383995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:30.384683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:30.388003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:30.388003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:30.394599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 527/1063] 10.222.0.86 () {56 vars in 1115 bytes} [Thu Aug 18 11:11:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:30.400415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:30.504880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a503d9-4a84-4d8a-ac7c-629340ab6261 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:30.540119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:30.540772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:30.541054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:30.541325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:30.553088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:30.554520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:30.568619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:30.569556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:30.570483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:30.570483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:30.570483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:30.572566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 537/1064] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:30.577128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:30.682289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22936d-2960-4253-b9be-cb025b6bc6ca None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:30.717109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:30.717721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:30.718004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:30.718280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:30.718927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:30.719229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:30.720624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:30.737998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 528/1065] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:30.739145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:30.768808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:30.844238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c3bd-20b3-4ad1-8bf6-6b45c53415ad None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:30.878971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fc05a-fec6-428f-8a21-bbbe7ec90c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:30.879604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc05a-fec6-428f-8a21-bbbe7ec90c19 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:30.879888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc05a-fec6-428f-8a21-bbbe7ec90c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:30.880165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fc05a-fec6-428f-8a21-bbbe7ec90c19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:30.887222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fc05a-fec6-428f-8a21-bbbe7ec90c19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:30.888681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fc05a-fec6-428f-8a21-bbbe7ec90c19 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8f0fc05a-fec6-428f-8a21-bbbe7ec90c19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:30.900447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:30.901402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:30.907461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 538/1066] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:11:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:30.908055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:30.909132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc1ea-30ce-43e0-8615-c89202df05d6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:30.909415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc1ea-30ce-43e0-8615-c89202df05d6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:30.909689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc1ea-30ce-43e0-8615-c89202df05d6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:30.911090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 539/1067] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:30.916114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571eb0e-a6ec-480a-a0af-016d2f19ad6a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:30.916439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571eb0e-a6ec-480a-a0af-016d2f19ad6a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:30.916719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571eb0e-a6ec-480a-a0af-016d2f19ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:30.938560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e571eb0e-a6ec-480a-a0af-016d2f19ad6a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:30.939684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e571eb0e-a6ec-480a-a0af-016d2f19ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:30.962046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.012351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 540/1068] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:31.013910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404f77c-6113-4597-99a1-6ba7afbb65c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.050224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.050838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.051118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.051391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.052124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:31.052463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.053891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.071223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 529/1069] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:11:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:31.076751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571eb0e-a6ec-480a-a0af-016d2f19ad6a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.095098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.179178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571eb0e-a6ec-480a-a0af-016d2f19ad6a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.217559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.218204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.218487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.218763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.232443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.233907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:31.249370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:31.250458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:31.251371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:31.251371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:31.251371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:31.252533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 541/1070] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:31.256400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.278773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.354408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.366826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9743217-91e7-4b2c-8747-5fefa33125f9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.377281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.389509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afc821-d658-4906-951d-81076b92a55f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.405273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.405902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.406184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.406462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.407117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:31.407425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.408887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.420577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 530/1071] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:31.426071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.432810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.433459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.433744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.434021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.503338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.504741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.535197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7000-5087-4b45-91ed-257e32a37fb3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.570358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.570965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.571101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.571267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.571523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.578925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.580413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:31.592566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:31.593514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:31.594408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 531/1072] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:31.599381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.616933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 542/1073] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 11:11:31.618042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.627557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.702074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910b1d-4c2a-4d52-ab9a-5d41db4f7fb2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.718453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fa576-e38e-4f89-a55f-49ffaf4debc9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.735546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b7508-934d-4291-ae71-71de3c261b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.736151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7508-934d-4291-ae71-71de3c261b1a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.736646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7508-934d-4291-ae71-71de3c261b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.736754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7508-934d-4291-ae71-71de3c261b1a None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.737418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b7508-934d-4291-ae71-71de3c261b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:31.737726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b7508-934d-4291-ae71-71de3c261b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.739167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b7508-934d-4291-ae71-71de3c261b1a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.752110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 532/1074] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:31.753557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdab03-b28f-4924-80c7-450c14328a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.754127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdab03-b28f-4924-80c7-450c14328a70 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.754403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdab03-b28f-4924-80c7-450c14328a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.754673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdab03-b28f-4924-80c7-450c14328a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.758278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d146-805c-4766-a8b3-ec4bb4ae18c7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.758572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d146-805c-4766-a8b3-ec4bb4ae18c7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.758851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d146-805c-4766-a8b3-ec4bb4ae18c7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.760098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 533/1075] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:31.760802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26d146-805c-4766-a8b3-ec4bb4ae18c7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.765134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdab03-b28f-4924-80c7-450c14328a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.766592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdab03-b28f-4924-80c7-450c14328a70 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-48bdab03-b28f-4924-80c7-450c14328a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:31.781415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:31.782409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:31.783300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:31.783300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:31.783300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:31.783300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 543/1076] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:31.783970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc751565-8951-4970-b2a8-d71fb4d3ac9a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.783970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc751565-8951-4970-b2a8-d71fb4d3ac9a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.784235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc751565-8951-4970-b2a8-d71fb4d3ac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.802923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fc751565-8951-4970-b2a8-d71fb4d3ac9a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:31.804106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fc751565-8951-4970-b2a8-d71fb4d3ac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:31.817979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.852056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:31.865582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26d146-805c-4766-a8b3-ec4bb4ae18c7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.872999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 544/1077] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:31.873766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc751565-8951-4970-b2a8-d71fb4d3ac9a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:31.901665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:31.903053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:31.903369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:31.903648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/748eb93057e245c1b8183dbe0340fa3f/roles/d2766df682dc448ca6aff60f115c96c1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:31.906032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=748eb93057e245c1b8183dbe0340fa3f, role_id=d2766df682dc448ca6aff60f115c96c1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:31.907386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:31.977935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc751565-8951-4970-b2a8-d71fb4d3ac9a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:31.979284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 534/1078] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:11:31 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/748eb93057e245c1b8183dbe0340fa3f/roles/d2766df682dc448ca6aff60f115c96c1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:11:32.031846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:32.032426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:32.032712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:32.032987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:32.033714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:32.034030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:32.035581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:32.049433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 545/1079] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:32.150839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:32.262494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a9329-c832-442b-b5ba-634a52b6ab66 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:32.304769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:32.305343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:32.305628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:32.305904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:32.317482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:32.322215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:32.323126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:32.324568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 535/1080] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:11:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:32.331555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:32.346523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:32.433935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd7c6-5374-47bc-aafc-8153de3dd891 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:32.467520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:32.468126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:32.468437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:32.468710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:32.469366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:32.469670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:32.471020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:32.479452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 546/1081] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:32.485547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:32.496799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:32.587295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5007b2-5d56-48de-8885-1cc31bac69f5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:32.621151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:32.622182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:32.622515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:32.622792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] PATH_INFO: `/v3/users/183568f74a1f47608f04b3f0249dea6b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:32.623911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] RBAC: Authorizing `identity:get_user(user_id=183568f74a1f47608f04b3f0249dea6b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:32.625356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:32.626925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 536/1082] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:32 2022] GET /identity/v3/users/183568f74a1f47608f04b3f0249dea6b => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:32.632720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:32.701875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:32.730474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe60d-003d-4985-9843-da8ec297c618 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:32.763930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2e9f3-e53d-4225-b4be-f32007e43b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:32.764587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e9f3-e53d-4225-b4be-f32007e43b2f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:32.764869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e9f3-e53d-4225-b4be-f32007e43b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:32.765145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e9f3-e53d-4225-b4be-f32007e43b2f None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:32.766248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2e9f3-e53d-4225-b4be-f32007e43b2f None admin] RBAC: Authorizing `identity:get_project(project_id=a93ce44fc5c2424681891c7353ed96f1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:32.767667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2e9f3-e53d-4225-b4be-f32007e43b2f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:32.769547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 547/1083] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:32 2022] GET /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:32.775242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:32.850218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:32.873143 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ef62c-be01-4996-944b-95a8e52a4e3d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:32.907149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37109ed2-b340-4aef-b25d-ff3cb583d159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:32.907794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109ed2-b340-4aef-b25d-ff3cb583d159 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:32.908073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109ed2-b340-4aef-b25d-ff3cb583d159 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:32.908379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37109ed2-b340-4aef-b25d-ff3cb583d159 None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1/users/183568f74a1f47608f04b3f0249dea6b/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:32.910376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37109ed2-b340-4aef-b25d-ff3cb583d159 None admin] RBAC: Authorizing `identity:create_grant(project_id=a93ce44fc5c2424681891c7353ed96f1, user_id=183568f74a1f47608f04b3f0249dea6b, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:32.912878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37109ed2-b340-4aef-b25d-ff3cb583d159 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:32.995023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 537/1084] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:11:32 2022] PUT /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1/users/183568f74a1f47608f04b3f0249dea6b/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:11:33.900360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9564015-a116-4a54-8049-b9d017e7bb34 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:33.900914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9564015-a116-4a54-8049-b9d017e7bb34 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:33.900914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9564015-a116-4a54-8049-b9d017e7bb34 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:33.902500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 548/1085] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:33.908013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4635a-a5e5-4e7f-9f44-8d6a1d848dea None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:33.908495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4635a-a5e5-4e7f-9f44-8d6a1d848dea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:33.908588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4635a-a5e5-4e7f-9f44-8d6a1d848dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:33.928001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8bd4635a-a5e5-4e7f-9f44-8d6a1d848dea None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:33.929195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8bd4635a-a5e5-4e7f-9f44-8d6a1d848dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:33.995097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 538/1086] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:34.263268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9564015-a116-4a54-8049-b9d017e7bb34 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:34.363828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9564015-a116-4a54-8049-b9d017e7bb34 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:34.396709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:34.397386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:34.397666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:34.397933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:34.406269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:34.409206 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:34.414104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:34.415054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:34.416074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 549/1087] 10.222.0.86 () {56 vars in 1120 bytes} [Thu Aug 18 11:11:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:34.421610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4635a-a5e5-4e7f-9f44-8d6a1d848dea None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:34.486287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:34.520697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4635a-a5e5-4e7f-9f44-8d6a1d848dea None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:34.555717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:34.556361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:34.556650 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:34.556929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:34.557605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:34.557915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:34.559330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:34.567491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 539/1088] 10.222.0.86 () {56 vars in 1115 bytes} [Thu Aug 18 11:11:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:34.573201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:34.672941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3be4-648c-40d1-a9e1-3eca1734700c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:34.705714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df61d4-7969-445b-8a90-c4dae28ed9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:34.706335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df61d4-7969-445b-8a90-c4dae28ed9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:34.706618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df61d4-7969-445b-8a90-c4dae28ed9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:34.706892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df61d4-7969-445b-8a90-c4dae28ed9e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:34.716606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df61d4-7969-445b-8a90-c4dae28ed9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:34.718038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df61d4-7969-445b-8a90-c4dae28ed9e6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-75df61d4-7969-445b-8a90-c4dae28ed9e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:34.732795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:34.733800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:34.734691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:34.734691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:34.734691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:34.734691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 550/1089] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:34.739933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:34.839956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2f484-6130-4817-84e3-edf490ad0bc2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:34.866586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:34.873026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f85f-8e82-4e3b-ab8d-b382f9180461 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:34.873361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f85f-8e82-4e3b-ab8d-b382f9180461 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:34.873582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f85f-8e82-4e3b-ab8d-b382f9180461 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:34.874891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:34.875045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 551/1090] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:34.875560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:34.875840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:34.876169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:34.877042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:34.877354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:34.878877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:34.879664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2841-fd8e-4066-b0b7-78b94610da7f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:34.879944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2841-fd8e-4066-b0b7-78b94610da7f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:34.880244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2841-fd8e-4066-b0b7-78b94610da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:34.893713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 540/1091] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:34.897016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:34.898745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ad7e2841-fd8e-4066-b0b7-78b94610da7f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:34.899921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ad7e2841-fd8e-4066-b0b7-78b94610da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:34.947734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:34.967856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 552/1092] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:34.997951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e29af-bc81-4425-b342-bf30e7830cda None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.030574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.031200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.031481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.031755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.038915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.040373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:11:35.052181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:35.053278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:35.054345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 541/1093] 10.222.0.86 () {56 vars in 1093 bytes} [Thu Aug 18 11:11:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:35.059225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2841-fd8e-4066-b0b7-78b94610da7f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.156185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2841-fd8e-4066-b0b7-78b94610da7f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.188327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.188927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.189205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.189475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.190189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:35.190489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.192030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.209895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 553/1094] 10.222.0.86 () {56 vars in 1133 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:35.216063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.239264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.269448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.280954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.324664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f55ca-1264-4b1f-b9a7-6598fe4283ac None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.337443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe41b7-d0cd-4e82-b7ae-ff208a6b4811 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.359015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.359627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.359906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.360184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.371559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.372181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.372487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.372759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.382511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:35.387943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:35.389109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:35.390160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 554/1095] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:35.394917 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.430577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.432070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.479047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.492921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.495548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f69fa-4278-49ee-974b-4cc6cf75d30c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.530587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.530904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 542/1096] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 11:11:35.531119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.531403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.531708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.532383 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:35.532692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.534054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.536683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.543891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 555/1097] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:35.549767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.633904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122eb1-34ae-495f-a364-6200c4cbabcf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.648875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee693-ccbc-4761-a9c4-6bf32bc24526 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.669259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.669891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.670172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.670447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.680515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.681968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.683115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.683738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.684018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.684324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] PATH_INFO: `/v3/users/183568f74a1f47608f04b3f0249dea6b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.685451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] RBAC: Authorizing `identity:get_user(user_id=183568f74a1f47608f04b3f0249dea6b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.686843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.688607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 556/1098] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/users/183568f74a1f47608f04b3f0249dea6b => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:35.691009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.694367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:11:35.697458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:35.706352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:11:35.707242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:11:35.707242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:11:35.707242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:35.707242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 543/1099] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:35.707242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.727357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.797174 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebbe79-ecff-4e03-b3f3-77390ffc5719 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.806837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064682c-082e-48e3-9b50-1e015357d25a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:35.834288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.834890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.835223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.835497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.841385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:35.841989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:35.842273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:35.842548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:35.843194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:35.843498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.844890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.856672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 544/1100] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:35.862261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:35.904122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:35.905607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:35.922526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.935486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:35.964732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62638652-b9c2-4939-9fff-821028e5fe48 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:36.000105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:36.000761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:36.001034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:36.001311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:36.004409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 557/1101] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 11:11:36.007933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:36.009407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:36.010274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:11:36.020468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:36.021548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:11:36.022646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 545/1102] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:11:36.027367 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:36.111084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5e48-a9f4-46a6-a187-65bc834c23a0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:36.126205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36868ab4-8ff8-4841-b5dc-42c0befd3269 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:36.139630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:36.145409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:36.145626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:36.146036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:36.146313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:36.146582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:36.147708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] RBAC: Authorizing `identity:get_project(project_id=a93ce44fc5c2424681891c7353ed96f1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:36.149232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:36.150836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 558/1103] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:36 2022] GET /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:36.157038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:36.165739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:36.165739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:36.165739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:36.165739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:36.166088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:36.166088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:36.166088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:36.177251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 546/1104] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:36.183886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:36.259944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f2ba-21a6-435c-9711-a644a4b47339 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:36.286146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c7cc-789f-4766-8f64-e70833111ea2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:36.294371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dc03f-b972-48f9-a3f1-49e6b302350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:36.294976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dc03f-b972-48f9-a3f1-49e6b302350a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:36.295255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dc03f-b972-48f9-a3f1-49e6b302350a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:36.295524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dc03f-b972-48f9-a3f1-49e6b302350a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:36.296259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dc03f-b972-48f9-a3f1-49e6b302350a None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=a93ce44fc5c2424681891c7353ed96f1, user.id=183568f74a1f47608f04b3f0249dea6b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:36.296569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dc03f-b972-48f9-a3f1-49e6b302350a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:36.298162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dc03f-b972-48f9-a3f1-49e6b302350a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:36.303813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 559/1105] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:36 2022] GET /identity/v3/role_assignments?user.id=183568f74a1f47608f04b3f0249dea6b&scope.project.id=a93ce44fc5c2424681891c7353ed96f1&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:36.321504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c694a7-f770-496b-91de-69cf1f523601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:36.322134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c694a7-f770-496b-91de-69cf1f523601 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:36.322419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c694a7-f770-496b-91de-69cf1f523601 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:36.322698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c694a7-f770-496b-91de-69cf1f523601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:36.323449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c694a7-f770-496b-91de-69cf1f523601 None admin] RBAC: Adding query filter params (role.id=d2766df682dc448ca6aff60f115c96c1, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=748eb93057e245c1b8183dbe0340fa3f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:36.323803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c694a7-f770-496b-91de-69cf1f523601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:36.325321 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c694a7-f770-496b-91de-69cf1f523601 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:36.332028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 547/1106] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:36 2022] GET /identity/v3/role_assignments?user.id=748eb93057e245c1b8183dbe0340fa3f&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=d2766df682dc448ca6aff60f115c96c1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:11:38.252677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe131-966a-434d-a21b-d9c3bf9b4851 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:38.253309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe131-966a-434d-a21b-d9c3bf9b4851 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:38.253309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe131-966a-434d-a21b-d9c3bf9b4851 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:38.254581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 560/1107] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:11:38.259646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a68f4-231c-4e0e-822b-3152d0cccfef None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:38.260056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a68f4-231c-4e0e-822b-3152d0cccfef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:38.260193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a68f4-231c-4e0e-822b-3152d0cccfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:38.278941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0a2a68f4-231c-4e0e-822b-3152d0cccfef None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:38.280116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0a2a68f4-231c-4e0e-822b-3152d0cccfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:38.319884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:38.345838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 548/1108] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:38.613756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbe131-966a-434d-a21b-d9c3bf9b4851 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:38.675664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:38.713670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbe131-966a-434d-a21b-d9c3bf9b4851 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:38.746581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8387e7-fe79-4cfb-a1fa-167d2b9eec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:38.747202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8387e7-fe79-4cfb-a1fa-167d2b9eec4f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:38.747485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8387e7-fe79-4cfb-a1fa-167d2b9eec4f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:38.747760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8387e7-fe79-4cfb-a1fa-167d2b9eec4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:38.748892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8387e7-fe79-4cfb-a1fa-167d2b9eec4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:38.750335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8387e7-fe79-4cfb-a1fa-167d2b9eec4f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:38.751882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 561/1109] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:38.757768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a68f4-231c-4e0e-822b-3152d0cccfef None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:38.852787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a68f4-231c-4e0e-822b-3152d0cccfef None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:38.885773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d0a47-dbb0-4e21-8026-948316daccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:38.887023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0a47-dbb0-4e21-8026-948316daccb4 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:38.887300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0a47-dbb0-4e21-8026-948316daccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:38.887571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d0a47-dbb0-4e21-8026-948316daccb4 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:38.888203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d0a47-dbb0-4e21-8026-948316daccb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:38.889646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d0a47-dbb0-4e21-8026-948316daccb4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:38.977973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 549/1110] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:11:38 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:40.902798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7873c-4df5-4096-91fe-3f5318a26750 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:40.903331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7873c-4df5-4096-91fe-3f5318a26750 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:40.903331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7873c-4df5-4096-91fe-3f5318a26750 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:40.904723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 562/1111] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:40.909744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d883-390e-4cf3-8ee2-65c7a33bf7d6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:40.910122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d883-390e-4cf3-8ee2-65c7a33bf7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:40.910295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d883-390e-4cf3-8ee2-65c7a33bf7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:40.928711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-32b4d883-390e-4cf3-8ee2-65c7a33bf7d6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:40.929885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-32b4d883-390e-4cf3-8ee2-65c7a33bf7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:40.953831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:40.994909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 550/1112] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:41.263228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7873c-4df5-4096-91fe-3f5318a26750 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:41.362538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7873c-4df5-4096-91fe-3f5318a26750 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:41.394103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:41.399748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:41.400409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:41.400691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:41.400967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] PATH_INFO: `/v3/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:41.403071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] RBAC: Authorizing `identity:get_role(role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:41.404463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:41.405784 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 563/1113] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:41 2022] GET /identity/v3/roles/e06796d7090a468581574c96a6f9f18e => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:41.412457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d883-390e-4cf3-8ee2-65c7a33bf7d6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:41.508327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d883-390e-4cf3-8ee2-65c7a33bf7d6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:41.541838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:41.542658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:41.542942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:41.543217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] PATH_INFO: `/v3/users/6d398bfc8de344859367157f2325f777` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:41.555901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] RBAC: Authorizing `identity:get_user(user_id=6d398bfc8de344859367157f2325f777)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:41.557368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:41.559876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 551/1114] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:41 2022] GET /identity/v3/users/6d398bfc8de344859367157f2325f777 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:41.565614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:41.662419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7412-01d6-4860-9337-7fcd72dc7734 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:41.695199 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:41.695793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:41.696082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:41.696387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:41.758050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:41.762145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:41.763523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:41.857481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 564/1115] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:11:41.863469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:41.882926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:41.962191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135a0e-3276-41fd-b040-17f27cbad85a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:41.994781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225a50-47b1-4c46-8f2e-8065a62054ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:41.996000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225a50-47b1-4c46-8f2e-8065a62054ce None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:41.996331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225a50-47b1-4c46-8f2e-8065a62054ce None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:41.996609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225a50-47b1-4c46-8f2e-8065a62054ce None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:41.997722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225a50-47b1-4c46-8f2e-8065a62054ce None admin] RBAC: Authorizing `identity:get_project(project_id=a93ce44fc5c2424681891c7353ed96f1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:41.999147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225a50-47b1-4c46-8f2e-8065a62054ce None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:42.000773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 552/1116] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:41 2022] GET /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:42.006962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:42.101632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:42.105926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020620fd-e07f-42c4-a8cb-8a66eb934446 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:42.140010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d9456-03f0-4c96-9fa8-48debbb5cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:42.140640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9456-03f0-4c96-9fa8-48debbb5cc93 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:42.140929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9456-03f0-4c96-9fa8-48debbb5cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:42.141210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d9456-03f0-4c96-9fa8-48debbb5cc93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:42.141927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d9456-03f0-4c96-9fa8-48debbb5cc93 None admin] RBAC: Adding query filter params (role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=a93ce44fc5c2424681891c7353ed96f1, user.id=6d398bfc8de344859367157f2325f777) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:42.142242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d9456-03f0-4c96-9fa8-48debbb5cc93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:42.143655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d9456-03f0-4c96-9fa8-48debbb5cc93 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:42.148835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 565/1117] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:42 2022] GET /identity/v3/role_assignments?user.id=6d398bfc8de344859367157f2325f777&scope.project.id=a93ce44fc5c2424681891c7353ed96f1&role.id=e06796d7090a468581574c96a6f9f18e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:44.014032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c60afc-8504-44cb-9e40-73fe22decda1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:44.014587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c60afc-8504-44cb-9e40-73fe22decda1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:44.014587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c60afc-8504-44cb-9e40-73fe22decda1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:44.015884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 553/1118] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:44.022351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102140d-5390-470d-9cd4-2f7c57214fae None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:44.022759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102140d-5390-470d-9cd4-2f7c57214fae None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:44.022891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102140d-5390-470d-9cd4-2f7c57214fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:44.041254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c102140d-5390-470d-9cd4-2f7c57214fae None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:44.043287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c102140d-5390-470d-9cd4-2f7c57214fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:44.107044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 566/1119] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:44.375335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c60afc-8504-44cb-9e40-73fe22decda1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:44.465835 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:44.481620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c60afc-8504-44cb-9e40-73fe22decda1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:44.515717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:44.516373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:44.516655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:44.516929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] PATH_INFO: `/v3/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:44.518310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] RBAC: Authorizing `identity:get_role(role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:44.519675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:44.520998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 554/1120] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:44 2022] GET /identity/v3/roles/e06796d7090a468581574c96a6f9f18e => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:44.527454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102140d-5390-470d-9cd4-2f7c57214fae None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:44.615013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:44.624037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102140d-5390-470d-9cd4-2f7c57214fae None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:44.657320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:44.657885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:44.658167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:44.658442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] PATH_INFO: `/v3/users/6d398bfc8de344859367157f2325f777` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:44.659546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] RBAC: Authorizing `identity:get_user(user_id=6d398bfc8de344859367157f2325f777)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:44.661248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:44.662806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 567/1121] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:44 2022] GET /identity/v3/users/6d398bfc8de344859367157f2325f777 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:44.668953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:44.766535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8befcf-2c19-4fa1-a222-8d981eaec7d3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:44.801054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373b97c-80a5-4087-8f5a-2e7e8aeda4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:44.801679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373b97c-80a5-4087-8f5a-2e7e8aeda4fe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:44.801962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373b97c-80a5-4087-8f5a-2e7e8aeda4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:44.802236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373b97c-80a5-4087-8f5a-2e7e8aeda4fe None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:44.803346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373b97c-80a5-4087-8f5a-2e7e8aeda4fe None admin] RBAC: Authorizing `identity:get_project(project_id=a93ce44fc5c2424681891c7353ed96f1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:44.804808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373b97c-80a5-4087-8f5a-2e7e8aeda4fe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:44.806414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 555/1122] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:44 2022] GET /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:44.812881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:44.909290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe97a3-3be3-48ba-ad86-f4eab4377348 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:44.942578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855bd1f-3f8b-4098-91cf-3e523f66e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:44.943210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bd1f-3f8b-4098-91cf-3e523f66e67d None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:44.943489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bd1f-3f8b-4098-91cf-3e523f66e67d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:44.943761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bd1f-3f8b-4098-91cf-3e523f66e67d None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1/users/6d398bfc8de344859367157f2325f777/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:44.945937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855bd1f-3f8b-4098-91cf-3e523f66e67d None admin] RBAC: Authorizing `identity:create_grant(project_id=a93ce44fc5c2424681891c7353ed96f1, user_id=6d398bfc8de344859367157f2325f777, role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:44.947342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855bd1f-3f8b-4098-91cf-3e523f66e67d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:45.031341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 568/1123] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:11:44 2022] PUT /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1/users/6d398bfc8de344859367157f2325f777/roles/e06796d7090a468581574c96a6f9f18e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:11:46.912488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294093c-0faf-4fc0-9e4d-75151b1116d9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:46.913016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294093c-0faf-4fc0-9e4d-75151b1116d9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:46.913138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294093c-0faf-4fc0-9e4d-75151b1116d9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:46.914365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 556/1124] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:46.920337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7dfe7-0166-4e87-a1d1-ee9f55213219 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:46.920732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7dfe7-0166-4e87-a1d1-ee9f55213219 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:46.920908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7dfe7-0166-4e87-a1d1-ee9f55213219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:46.938567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-90e7dfe7-0166-4e87-a1d1-ee9f55213219 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:46.939752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-90e7dfe7-0166-4e87-a1d1-ee9f55213219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:46.953413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:47.005192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 569/1125] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:47.279015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294093c-0faf-4fc0-9e4d-75151b1116d9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:47.303022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:47.378084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294093c-0faf-4fc0-9e4d-75151b1116d9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:47.411270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:47.411892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:47.412174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:47.412480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] PATH_INFO: `/v3/roles/e06796d7090a468581574c96a6f9f18e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:47.413859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] RBAC: Authorizing `identity:get_role(role_id=e06796d7090a468581574c96a6f9f18e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:47.415220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:47.416539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 557/1126] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:47 2022] GET /identity/v3/roles/e06796d7090a468581574c96a6f9f18e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:47.422475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7dfe7-0166-4e87-a1d1-ee9f55213219 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:47.517537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7dfe7-0166-4e87-a1d1-ee9f55213219 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:47.550465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:47.551081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:47.551362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:47.551632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] PATH_INFO: `/v3/users/6d398bfc8de344859367157f2325f777` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:47.552761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] RBAC: Authorizing `identity:get_user(user_id=6d398bfc8de344859367157f2325f777)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:47.554161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:47.555699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 570/1127] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:47 2022] GET /identity/v3/users/6d398bfc8de344859367157f2325f777 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:47.561849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:47.648959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:47.658459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2f162-690d-42de-8d48-25f36d2d89da None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:47.691821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:47.692444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:47.692727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:47.693003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:47.757800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:47.759233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:47.844835 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:47.854443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 558/1128] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:11:47.860502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:47.879874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:47.958963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0a32-eaf1-4a12-b9ed-edda025cdcdd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:47.991942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a17d8-5401-4cc1-b0f0-dba32f1064a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:47.992586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a17d8-5401-4cc1-b0f0-dba32f1064a9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:47.992867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a17d8-5401-4cc1-b0f0-dba32f1064a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:47.993141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a17d8-5401-4cc1-b0f0-dba32f1064a9 None admin] PATH_INFO: `/v3/projects/a93ce44fc5c2424681891c7353ed96f1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:47.994233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a17d8-5401-4cc1-b0f0-dba32f1064a9 None admin] RBAC: Authorizing `identity:get_project(project_id=a93ce44fc5c2424681891c7353ed96f1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:47.996225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a17d8-5401-4cc1-b0f0-dba32f1064a9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:47.997840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 571/1129] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:47 2022] GET /identity/v3/projects/a93ce44fc5c2424681891c7353ed96f1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:48.003935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:48.099962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39e550-b886-481b-997d-2e68fa5ef651 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:48.133119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced42a20-8418-47f8-9c22-d53ca2675dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:48.133708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced42a20-8418-47f8-9c22-d53ca2675dbe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:48.133986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced42a20-8418-47f8-9c22-d53ca2675dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:48.134255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced42a20-8418-47f8-9c22-d53ca2675dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:48.134971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced42a20-8418-47f8-9c22-d53ca2675dbe None admin] RBAC: Adding query filter params (role.id=e06796d7090a468581574c96a6f9f18e, scope.project.id=a93ce44fc5c2424681891c7353ed96f1, user.id=6d398bfc8de344859367157f2325f777) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:48.135275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced42a20-8418-47f8-9c22-d53ca2675dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:48.136875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced42a20-8418-47f8-9c22-d53ca2675dbe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:48.142429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 559/1130] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:48 2022] GET /identity/v3/role_assignments?user.id=6d398bfc8de344859367157f2325f777&scope.project.id=a93ce44fc5c2424681891c7353ed96f1&role.id=e06796d7090a468581574c96a6f9f18e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:50.206998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca160-6456-4c63-8845-77ef6f690b24 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:50.207370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca160-6456-4c63-8845-77ef6f690b24 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:50.207466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca160-6456-4c63-8845-77ef6f690b24 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:50.208750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 572/1131] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:50.214184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33155c-371a-4dce-89dd-67cd6a846b17 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:50.214621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33155c-371a-4dce-89dd-67cd6a846b17 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:50.214749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33155c-371a-4dce-89dd-67cd6a846b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:50.234479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5a33155c-371a-4dce-89dd-67cd6a846b17 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:50.235675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5a33155c-371a-4dce-89dd-67cd6a846b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:50.284284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:50.301748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 560/1132] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:50.573279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aca160-6456-4c63-8845-77ef6f690b24 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:50.656660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:50.672234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aca160-6456-4c63-8845-77ef6f690b24 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:50.706224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c6bdb-1f0c-457b-87b0-ce3cb0e12527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:50.706836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c6bdb-1f0c-457b-87b0-ce3cb0e12527 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:50.707114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c6bdb-1f0c-457b-87b0-ce3cb0e12527 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:50.707384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c6bdb-1f0c-457b-87b0-ce3cb0e12527 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:50.708494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c6bdb-1f0c-457b-87b0-ce3cb0e12527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:50.709900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c6bdb-1f0c-457b-87b0-ce3cb0e12527 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:50.711441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 573/1133] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:50.717978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33155c-371a-4dce-89dd-67cd6a846b17 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:50.813775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33155c-371a-4dce-89dd-67cd6a846b17 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:50.850027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c61a6-c7c5-4636-ab5a-ca7539e5dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:50.850027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c61a6-c7c5-4636-ab5a-ca7539e5dbb0 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:50.850027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c61a6-c7c5-4636-ab5a-ca7539e5dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:50.850027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c61a6-c7c5-4636-ab5a-ca7539e5dbb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:50.850421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c61a6-c7c5-4636-ab5a-ca7539e5dbb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:50.850421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c61a6-c7c5-4636-ab5a-ca7539e5dbb0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:50.950767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 561/1134] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:11:50 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:52.860528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378d99-54eb-489c-ac30-73ca9cb3a143 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:52.861103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378d99-54eb-489c-ac30-73ca9cb3a143 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:52.861103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378d99-54eb-489c-ac30-73ca9cb3a143 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:52.862458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 574/1135] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:52.867493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8708308-416d-4cd2-9970-a7446611899e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:52.867906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8708308-416d-4cd2-9970-a7446611899e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:52.868154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8708308-416d-4cd2-9970-a7446611899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:52.887094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f8708308-416d-4cd2-9970-a7446611899e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:52.888314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f8708308-416d-4cd2-9970-a7446611899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:52.916414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:52.954382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 562/1136] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:53.226691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d378d99-54eb-489c-ac30-73ca9cb3a143 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:53.326107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d378d99-54eb-489c-ac30-73ca9cb3a143 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:53.359033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70430121-9eb1-4ce2-9399-7fa83252df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:53.359658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70430121-9eb1-4ce2-9399-7fa83252df8f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:53.359925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70430121-9eb1-4ce2-9399-7fa83252df8f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:53.360198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70430121-9eb1-4ce2-9399-7fa83252df8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:53.361327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70430121-9eb1-4ce2-9399-7fa83252df8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:53.362755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70430121-9eb1-4ce2-9399-7fa83252df8f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:53.364324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 575/1137] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:11:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:53.370255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8708308-416d-4cd2-9970-a7446611899e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:53.466544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8708308-416d-4cd2-9970-a7446611899e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:53.498682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adc245-85d7-469a-af73-a2efa7eb37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:53.499280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc245-85d7-469a-af73-a2efa7eb37ac None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:53.499564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc245-85d7-469a-af73-a2efa7eb37ac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:53.499839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adc245-85d7-469a-af73-a2efa7eb37ac None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:53.500520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adc245-85d7-469a-af73-a2efa7eb37ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:53.501957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adc245-85d7-469a-af73-a2efa7eb37ac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:53.601262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 563/1138] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:11:53 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:11:55.547338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1eaf-b34c-4773-8a17-894425acff60 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:55.547848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1eaf-b34c-4773-8a17-894425acff60 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:55.547962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d1eaf-b34c-4773-8a17-894425acff60 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:55.549285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 576/1139] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:55.554485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0f89-d375-4546-bf2a-1d6d25bfdd78 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:55.554883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0f89-d375-4546-bf2a-1d6d25bfdd78 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:55.555042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0f89-d375-4546-bf2a-1d6d25bfdd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:55.574022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-75ff0f89-d375-4546-bf2a-1d6d25bfdd78 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:55.575197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75ff0f89-d375-4546-bf2a-1d6d25bfdd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:55.591758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:55.641308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 564/1140] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:11:55.913367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d1eaf-b34c-4773-8a17-894425acff60 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:55.937655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:56.012808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d1eaf-b34c-4773-8a17-894425acff60 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:56.045231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:56.045851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:56.046133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:56.046408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:56.056160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:56.061281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:56.062491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:56.063623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 577/1141] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:56.068509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff0f89-d375-4546-bf2a-1d6d25bfdd78 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:56.167628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff0f89-d375-4546-bf2a-1d6d25bfdd78 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:56.200256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:56.200854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:56.201134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:56.201404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:56.202067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:56.202369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:56.203732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:56.211955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 565/1142] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:56.217775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:56.297786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:56.315532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d91ce-b077-43c4-93d7-e9f8e399a1a7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:56.348263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:56.348882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:56.349164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:56.349440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] PATH_INFO: `/v3/users/6aa0bbfab5da4a7592bf220fe125d49f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:56.362469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] RBAC: Authorizing `identity:get_user(user_id=6aa0bbfab5da4a7592bf220fe125d49f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:56.363877 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:56.365461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 578/1143] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:56 2022] GET /identity/v3/users/6aa0bbfab5da4a7592bf220fe125d49f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:56.371925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:56.388320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:56.469088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ef496-2edf-43e7-bde4-6ab1b78b2981 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:56.501517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:56.502117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:56.502398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:56.502674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:56.568262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:56.569713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:56.583475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:56.665796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 566/1144] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:11:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:11:56.672273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:56.768297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a89e-e50a-4507-82bd-1d2f0e6dab56 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:56.802084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91f922-a931-4954-ae17-4b10bfa88060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:56.802710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f922-a931-4954-ae17-4b10bfa88060 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:56.802995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f922-a931-4954-ae17-4b10bfa88060 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:56.803272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91f922-a931-4954-ae17-4b10bfa88060 None admin] PATH_INFO: `/v3/projects/1f738235867e451daf658defc5f5dba2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:56.804403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91f922-a931-4954-ae17-4b10bfa88060 None admin] RBAC: Authorizing `identity:get_project(project_id=1f738235867e451daf658defc5f5dba2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:56.805820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91f922-a931-4954-ae17-4b10bfa88060 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:56.807557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 579/1145] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:56 2022] GET /identity/v3/projects/1f738235867e451daf658defc5f5dba2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:56.813582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:56.910075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290e9c7-af45-43f0-bf1f-631f8f9a6588 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:56.923918 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:56.943285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18b4e5-a8cd-4e11-bf0d-c3fdc3a354b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:56.943879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18b4e5-a8cd-4e11-bf0d-c3fdc3a354b3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:56.944160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18b4e5-a8cd-4e11-bf0d-c3fdc3a354b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:56.944463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18b4e5-a8cd-4e11-bf0d-c3fdc3a354b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:56.945182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18b4e5-a8cd-4e11-bf0d-c3fdc3a354b3 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=1f738235867e451daf658defc5f5dba2, user.id=6aa0bbfab5da4a7592bf220fe125d49f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:56.945491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18b4e5-a8cd-4e11-bf0d-c3fdc3a354b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:56.946908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18b4e5-a8cd-4e11-bf0d-c3fdc3a354b3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:56.953039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 567/1146] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:11:56 2022] GET /identity/v3/role_assignments?user.id=6aa0bbfab5da4a7592bf220fe125d49f&scope.project.id=1f738235867e451daf658defc5f5dba2&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:58.839871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a219cc2-b165-460e-bdee-d6b7f41e79f5 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:58.840635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a219cc2-b165-460e-bdee-d6b7f41e79f5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:58.840635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a219cc2-b165-460e-bdee-d6b7f41e79f5 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:58.841765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 580/1147] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:11:58.847049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753600ed-c8e3-4267-8fa8-70f8adbd9eb0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:58.847470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753600ed-c8e3-4267-8fa8-70f8adbd9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:58.847603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753600ed-c8e3-4267-8fa8-70f8adbd9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:58.865800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-753600ed-c8e3-4267-8fa8-70f8adbd9eb0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:11:58.866971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-753600ed-c8e3-4267-8fa8-70f8adbd9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:11:58.932345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 568/1148] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:11:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:11:59.207482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a219cc2-b165-460e-bdee-d6b7f41e79f5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:59.219029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:59.307630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a219cc2-b165-460e-bdee-d6b7f41e79f5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:59.341159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:59.341796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:59.342080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:59.342357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:59.352065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:11:59.356715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:11:59.357812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:11:59.358676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 581/1149] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:11:59.363920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753600ed-c8e3-4267-8fa8-70f8adbd9eb0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:59.458904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753600ed-c8e3-4267-8fa8-70f8adbd9eb0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:59.468376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:59.491825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:59.492458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:59.492741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:59.493016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:59.493676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:11:59.493983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:59.495377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:59.503359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 569/1150] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:59.509144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:59.576751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:11:59.609353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdd09b-7b71-4572-bb04-8d3164108d83 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:59.642303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:59.643004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:59.643300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:59.643579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] PATH_INFO: `/v3/users/6aa0bbfab5da4a7592bf220fe125d49f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:59.644712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=6aa0bbfab5da4a7592bf220fe125d49f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:59.646129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:59.647682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 582/1151] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:11:59 2022] GET /identity/v3/users/6aa0bbfab5da4a7592bf220fe125d49f => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:59.653621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:59.751118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a2cc-2d16-4bb6-b7e5-1166ee4e29a0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:59.783494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc42108-3eab-43be-8368-1a5f9e48f92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:59.784147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42108-3eab-43be-8368-1a5f9e48f92b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:59.784461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42108-3eab-43be-8368-1a5f9e48f92b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:59.784739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42108-3eab-43be-8368-1a5f9e48f92b None admin] PATH_INFO: `/v3/projects/1f738235867e451daf658defc5f5dba2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:59.786116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc42108-3eab-43be-8368-1a5f9e48f92b None admin] RBAC: Authorizing `identity:get_project(project_id=1f738235867e451daf658defc5f5dba2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:59.787543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc42108-3eab-43be-8368-1a5f9e48f92b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:59.789177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 570/1152] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:11:59 2022] GET /identity/v3/projects/1f738235867e451daf658defc5f5dba2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:11:59.795280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:11:59.892283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db131-9104-488e-9b1a-c3ffb24f6ee3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:11:59.925198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72b452-7b29-4243-8ea6-401a19c2cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:11:59.925847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b452-7b29-4243-8ea6-401a19c2cb39 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:11:59.926131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b452-7b29-4243-8ea6-401a19c2cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:11:59.926411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72b452-7b29-4243-8ea6-401a19c2cb39 None admin] PATH_INFO: `/v3/projects/1f738235867e451daf658defc5f5dba2/users/6aa0bbfab5da4a7592bf220fe125d49f/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:11:59.928399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72b452-7b29-4243-8ea6-401a19c2cb39 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f738235867e451daf658defc5f5dba2, user_id=6aa0bbfab5da4a7592bf220fe125d49f, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:11:59.929828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72b452-7b29-4243-8ea6-401a19c2cb39 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:11:59.933364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:00.051947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 583/1153] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:11:59 2022] PUT /identity/v3/projects/1f738235867e451daf658defc5f5dba2/users/6aa0bbfab5da4a7592bf220fe125d49f/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:01.932774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9fe43-95fc-451a-9c35-a849c68a2400 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:01.933310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9fe43-95fc-451a-9c35-a849c68a2400 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:01.933403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9fe43-95fc-451a-9c35-a849c68a2400 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:01.934725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 571/1154] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:01.940462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef92501-c86a-4c4e-85be-1d1b147e0dcb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:01.940965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef92501-c86a-4c4e-85be-1d1b147e0dcb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:01.941472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef92501-c86a-4c4e-85be-1d1b147e0dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:01.960403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6ef92501-c86a-4c4e-85be-1d1b147e0dcb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:01.961610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6ef92501-c86a-4c4e-85be-1d1b147e0dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:02.025114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 584/1155] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:02.294979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9fe43-95fc-451a-9c35-a849c68a2400 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:02.335296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:02.394104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9fe43-95fc-451a-9c35-a849c68a2400 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:02.426465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:02.427078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:02.427353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:02.427621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:02.438462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:12:02.443058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:12:02.444136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:12:02.445340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 572/1156] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:12:02.450382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef92501-c86a-4c4e-85be-1d1b147e0dcb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:02.545796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef92501-c86a-4c4e-85be-1d1b147e0dcb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:02.570718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:02.579028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:02.587153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:02.587153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:02.587153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:02.587153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:02.587153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:02.587153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:02.590799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 585/1157] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:02.596569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:02.691484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:02.694904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8929-6562-4bbb-a263-82b51c6f395e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:02.727571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:02.728187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:02.729153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:02.729421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] PATH_INFO: `/v3/users/6aa0bbfab5da4a7592bf220fe125d49f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:02.730522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] RBAC: Authorizing `identity:get_user(user_id=6aa0bbfab5da4a7592bf220fe125d49f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:02.731941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:02.733509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 573/1158] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:12:02 2022] GET /identity/v3/users/6aa0bbfab5da4a7592bf220fe125d49f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:02.739406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:02.835619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de9ebd-d891-476d-9dee-f449fe5507e1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:02.868559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb79671-04df-4a68-b237-960485052105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:02.869189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79671-04df-4a68-b237-960485052105 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:02.869567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79671-04df-4a68-b237-960485052105 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:02.869852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79671-04df-4a68-b237-960485052105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:02.923533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:02.935055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb79671-04df-4a68-b237-960485052105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:02.936578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb79671-04df-4a68-b237-960485052105 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:03.032168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 586/1159] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:12:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:12:03.038314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:03.136038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777133-136f-4e5c-a996-8f0b27931058 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:03.169306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5583a-1c9a-48cb-b902-5b73b4c7722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:03.169924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5583a-1c9a-48cb-b902-5b73b4c7722c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:03.170209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5583a-1c9a-48cb-b902-5b73b4c7722c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:03.170486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5583a-1c9a-48cb-b902-5b73b4c7722c None admin] PATH_INFO: `/v3/projects/1f738235867e451daf658defc5f5dba2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:03.171596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5583a-1c9a-48cb-b902-5b73b4c7722c None admin] RBAC: Authorizing `identity:get_project(project_id=1f738235867e451daf658defc5f5dba2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:03.173049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5583a-1c9a-48cb-b902-5b73b4c7722c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:03.174638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 574/1160] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:12:03 2022] GET /identity/v3/projects/1f738235867e451daf658defc5f5dba2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:03.180659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb79671-04df-4a68-b237-960485052105 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:03.266145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:03.278363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb79671-04df-4a68-b237-960485052105 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:03.312056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3992e-8b75-40a8-b874-f7b1cfde9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:03.312682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3992e-8b75-40a8-b874-f7b1cfde9788 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:03.312963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3992e-8b75-40a8-b874-f7b1cfde9788 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:03.313235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3992e-8b75-40a8-b874-f7b1cfde9788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:03.313948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3992e-8b75-40a8-b874-f7b1cfde9788 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=1f738235867e451daf658defc5f5dba2, user.id=6aa0bbfab5da4a7592bf220fe125d49f) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:03.314261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3992e-8b75-40a8-b874-f7b1cfde9788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:03.315663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3992e-8b75-40a8-b874-f7b1cfde9788 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:03.321189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 587/1161] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:12:03 2022] GET /identity/v3/role_assignments?user.id=6aa0bbfab5da4a7592bf220fe125d49f&scope.project.id=1f738235867e451daf658defc5f5dba2&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:05.236721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafa003-a5c5-4f1d-83d2-fd555aa60052 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:05.237227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafa003-a5c5-4f1d-83d2-fd555aa60052 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:05.237327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafa003-a5c5-4f1d-83d2-fd555aa60052 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:05.238579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 575/1162] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:05.243632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9670-9051-4da1-8b5f-a663b8fc0eda None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:05.244828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9670-9051-4da1-8b5f-a663b8fc0eda None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:05.244828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9670-9051-4da1-8b5f-a663b8fc0eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:05.262356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-99ee9670-9051-4da1-8b5f-a663b8fc0eda None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:05.263530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-99ee9670-9051-4da1-8b5f-a663b8fc0eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:05.328565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 588/1163] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:05.597730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafa003-a5c5-4f1d-83d2-fd555aa60052 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:05.633432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:05.698632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafa003-a5c5-4f1d-83d2-fd555aa60052 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:05.731841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:05.732454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:05.732734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:05.733007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:05.797405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:05.798830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:05.830784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:05.894860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 576/1164] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:12:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:12:05.901529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee9670-9051-4da1-8b5f-a663b8fc0eda None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:05.979876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:05.998349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee9670-9051-4da1-8b5f-a663b8fc0eda None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:06.031604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf452-ce2f-4312-b48d-46319a434423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:06.032247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf452-ce2f-4312-b48d-46319a434423 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:06.032534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf452-ce2f-4312-b48d-46319a434423 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:06.032809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf452-ce2f-4312-b48d-46319a434423 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:06.039461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf452-ce2f-4312-b48d-46319a434423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:06.041490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf452-ce2f-4312-b48d-46319a434423 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9f5bf452-ce2f-4312-b48d-46319a434423 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:12:06.053055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:12:06.054299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:12:06.055558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 589/1165] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:12:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:12:06.060622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:06.155368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84020-da1b-4c18-956f-0b24f86da9a5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:06.188144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6737ca-4408-4a6f-afb0-f9842687f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:06.188765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6737ca-4408-4a6f-afb0-f9842687f6fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:06.189043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6737ca-4408-4a6f-afb0-f9842687f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:06.189313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6737ca-4408-4a6f-afb0-f9842687f6fd None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:06.189945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6737ca-4408-4a6f-afb0-f9842687f6fd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:06.190243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6737ca-4408-4a6f-afb0-f9842687f6fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:06.191588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6737ca-4408-4a6f-afb0-f9842687f6fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:06.193039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:06.199092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 577/1166] 10.222.0.86 () {56 vars in 1115 bytes} [Thu Aug 18 11:12:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:08.076262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87697ef-5af1-4efe-bafe-8beb01b5c834 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:08.076788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87697ef-5af1-4efe-bafe-8beb01b5c834 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:08.076788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87697ef-5af1-4efe-bafe-8beb01b5c834 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:08.078140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 590/1167] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:08.083203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553fa5-e6a0-4c96-9e15-97c9fd5ec65b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:08.083622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553fa5-e6a0-4c96-9e15-97c9fd5ec65b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:08.083734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553fa5-e6a0-4c96-9e15-97c9fd5ec65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:08.101341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-64553fa5-e6a0-4c96-9e15-97c9fd5ec65b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:08.102500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64553fa5-e6a0-4c96-9e15-97c9fd5ec65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:08.168860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 578/1168] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:08.435198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87697ef-5af1-4efe-bafe-8beb01b5c834 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:08.536042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87697ef-5af1-4efe-bafe-8beb01b5c834 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:08.571541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0c3bd-8dd1-4d22-ad17-c8ebe1f61954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:08.572551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c3bd-8dd1-4d22-ad17-c8ebe1f61954 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:08.572843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c3bd-8dd1-4d22-ad17-c8ebe1f61954 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:08.573116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0c3bd-8dd1-4d22-ad17-c8ebe1f61954 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:08.573766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0c3bd-8dd1-4d22-ad17-c8ebe1f61954 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:08.575111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0c3bd-8dd1-4d22-ad17-c8ebe1f61954 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:08.670430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 591/1169] 10.222.0.86 () {60 vars in 1138 bytes} [Thu Aug 18 11:12:08 2022] POST /identity/v3/domains => generated 267 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:10.586008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ce3fe-7bf6-41a9-b882-c4c143e08476 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:10.586533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ce3fe-7bf6-41a9-b882-c4c143e08476 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:10.586624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ce3fe-7bf6-41a9-b882-c4c143e08476 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:10.588596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 579/1170] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:10.593632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee150c87-a40c-4237-bb83-5cb6613447d0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:10.594055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee150c87-a40c-4237-bb83-5cb6613447d0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:10.594185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee150c87-a40c-4237-bb83-5cb6613447d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:10.600435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:10.612020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ee150c87-a40c-4237-bb83-5cb6613447d0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:10.618137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ee150c87-a40c-4237-bb83-5cb6613447d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:10.678632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 592/1171] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:10.946448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ce3fe-7bf6-41a9-b882-c4c143e08476 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:11.044890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ce3fe-7bf6-41a9-b882-c4c143e08476 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:11.074357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:11.081710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26363574-550b-470c-9907-44ce5898e43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:11.087778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363574-550b-470c-9907-44ce5898e43c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:11.087778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363574-550b-470c-9907-44ce5898e43c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:11.087778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26363574-550b-470c-9907-44ce5898e43c None admin] PATH_INFO: `/v3/domains/9543fa2529724744b8712cbef979426b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:11.093605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26363574-550b-470c-9907-44ce5898e43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=9543fa2529724744b8712cbef979426b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:11.095200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26363574-550b-470c-9907-44ce5898e43c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:11.097052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 580/1172] 10.222.0.86 () {56 vars in 1183 bytes} [Thu Aug 18 11:12:10 2022] GET /identity/v3/domains/9543fa2529724744b8712cbef979426b => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:11.102694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee150c87-a40c-4237-bb83-5cb6613447d0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:11.199078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee150c87-a40c-4237-bb83-5cb6613447d0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:11.227852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:11.232889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a80148-ab43-4159-9f71-8d087f821ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:11.233498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a80148-ab43-4159-9f71-8d087f821ccd None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:11.233781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a80148-ab43-4159-9f71-8d087f821ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:11.234055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a80148-ab43-4159-9f71-8d087f821ccd None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:11.234706 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a80148-ab43-4159-9f71-8d087f821ccd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:11.236127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a80148-ab43-4159-9f71-8d087f821ccd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:11.315195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 593/1173] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:12:11 2022] POST /identity/v3/projects => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:12:13.238575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ea20-cbd3-4da5-b7e6-142fc6514d72 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:13.239098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ea20-cbd3-4da5-b7e6-142fc6514d72 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:13.239207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ea20-cbd3-4da5-b7e6-142fc6514d72 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:13.240616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 581/1174] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:13.246247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a009aa-b3de-4b28-bc0a-90f464f2a396 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:13.246637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a009aa-b3de-4b28-bc0a-90f464f2a396 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:13.246801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a009aa-b3de-4b28-bc0a-90f464f2a396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:13.265266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-29a009aa-b3de-4b28-bc0a-90f464f2a396 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:13.266446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-29a009aa-b3de-4b28-bc0a-90f464f2a396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:13.331323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 594/1175] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:13.598491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ea20-cbd3-4da5-b7e6-142fc6514d72 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:13.698654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ea20-cbd3-4da5-b7e6-142fc6514d72 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:13.730687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac04429-a016-47ca-a946-b6b984f1f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:13.731306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04429-a016-47ca-a946-b6b984f1f781 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:13.731588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04429-a016-47ca-a946-b6b984f1f781 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:13.731863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04429-a016-47ca-a946-b6b984f1f781 None admin] PATH_INFO: `/v3/domains/9543fa2529724744b8712cbef979426b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:13.733002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac04429-a016-47ca-a946-b6b984f1f781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9543fa2529724744b8712cbef979426b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:13.734431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac04429-a016-47ca-a946-b6b984f1f781 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:13.735965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 582/1176] 10.222.0.86 () {56 vars in 1183 bytes} [Thu Aug 18 11:12:13 2022] GET /identity/v3/domains/9543fa2529724744b8712cbef979426b => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:13.741768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a009aa-b3de-4b28-bc0a-90f464f2a396 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:13.836579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a009aa-b3de-4b28-bc0a-90f464f2a396 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:13.858013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:13.870620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062acb22-091a-4a7a-9a4e-8728541ea65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:13.871224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062acb22-091a-4a7a-9a4e-8728541ea65a None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:13.871527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062acb22-091a-4a7a-9a4e-8728541ea65a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:13.871806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062acb22-091a-4a7a-9a4e-8728541ea65a None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:13.872483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062acb22-091a-4a7a-9a4e-8728541ea65a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:13.873963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062acb22-091a-4a7a-9a4e-8728541ea65a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:13.937208 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 595/1177] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:12:13 2022] POST /identity/v3/users => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:12:15.863663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107373-cbb5-4bfd-a6af-3503019e224a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:15.864256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107373-cbb5-4bfd-a6af-3503019e224a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:15.864256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107373-cbb5-4bfd-a6af-3503019e224a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:15.865800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 583/1178] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:15.870867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81854f9-2343-4599-b1fe-84ece40c8b9f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:15.871248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81854f9-2343-4599-b1fe-84ece40c8b9f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:15.871429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81854f9-2343-4599-b1fe-84ece40c8b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:15.890434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c81854f9-2343-4599-b1fe-84ece40c8b9f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:15.894386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c81854f9-2343-4599-b1fe-84ece40c8b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:15.956170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 596/1179] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:16.223391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da107373-cbb5-4bfd-a6af-3503019e224a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:16.280468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:16.325169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da107373-cbb5-4bfd-a6af-3503019e224a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:16.358852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:16.359475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:16.359763 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:16.360043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:16.371086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:12:16.375793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:12:16.376977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:12:16.378227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 584/1180] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:12:16.382974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81854f9-2343-4599-b1fe-84ece40c8b9f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:16.476601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:16.479429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81854f9-2343-4599-b1fe-84ece40c8b9f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:16.512540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:16.513135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:16.513419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:16.513696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:16.514356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:16.514661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:16.516028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:16.523812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 597/1181] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:16.530185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:16.627513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd0052-11ab-42e9-a412-97d84495c93f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:16.643711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:16.661726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:16.662348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:16.662630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:16.662903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] PATH_INFO: `/v3/users/7f773fe589194ceaa5bd879a574e0327` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:16.676226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] RBAC: Authorizing `identity:get_user(user_id=7f773fe589194ceaa5bd879a574e0327)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:16.677678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:16.679241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 585/1182] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:12:16 2022] GET /identity/v3/users/7f773fe589194ceaa5bd879a574e0327 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:16.685305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:16.781175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486571-0587-467c-bf00-0bb7a3c3bc0d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:16.813262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:16.813856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:16.814137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:16.814412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:16.843517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:16.879969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:16.881437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:16.978369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 598/1183] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:12:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:12:16.984335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:17.082381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc860-d2eb-4b42-b7f6-3556dbe00a63 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:17.114560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35426f-bc13-4b8d-affc-2dd4bb970e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:17.115177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35426f-bc13-4b8d-affc-2dd4bb970e2c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:17.115457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35426f-bc13-4b8d-affc-2dd4bb970e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:17.115730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35426f-bc13-4b8d-affc-2dd4bb970e2c None admin] PATH_INFO: `/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:17.116833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35426f-bc13-4b8d-affc-2dd4bb970e2c None admin] RBAC: Authorizing `identity:get_project(project_id=9dd6eb9d501b41e0b5c06f4d6301f159)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:17.118768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35426f-bc13-4b8d-affc-2dd4bb970e2c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:17.120374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 586/1184] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:12:16 2022] GET /identity/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:17.126472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:17.186715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:17.225036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6f22-0c68-46b2-920a-24e7855e231f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:17.258348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775bfe0-21b8-4e69-8649-0effcaee3b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:17.258978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775bfe0-21b8-4e69-8649-0effcaee3b06 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:17.259258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775bfe0-21b8-4e69-8649-0effcaee3b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:17.259531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775bfe0-21b8-4e69-8649-0effcaee3b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:17.260271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775bfe0-21b8-4e69-8649-0effcaee3b06 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=9dd6eb9d501b41e0b5c06f4d6301f159, user.id=7f773fe589194ceaa5bd879a574e0327) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:17.260584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775bfe0-21b8-4e69-8649-0effcaee3b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:17.261993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775bfe0-21b8-4e69-8649-0effcaee3b06 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:17.267139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 599/1185] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:12:17 2022] GET /identity/v3/role_assignments?user.id=7f773fe589194ceaa5bd879a574e0327&scope.project.id=9dd6eb9d501b41e0b5c06f4d6301f159&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:19.122972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91e47-c0c5-471a-ada8-b471a0738b7f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:19.123525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91e47-c0c5-471a-ada8-b471a0738b7f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:19.123525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91e47-c0c5-471a-ada8-b471a0738b7f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:19.124846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 587/1186] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:19.130009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e02bf-c3a2-4641-b808-218e3ac9ed49 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:19.130404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e02bf-c3a2-4641-b808-218e3ac9ed49 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:19.130556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e02bf-c3a2-4641-b808-218e3ac9ed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:19.148268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e06e02bf-c3a2-4641-b808-218e3ac9ed49 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:19.150033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e06e02bf-c3a2-4641-b808-218e3ac9ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:19.216185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 600/1187] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:19.480354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91e47-c0c5-471a-ada8-b471a0738b7f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:19.523039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:19.579439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91e47-c0c5-471a-ada8-b471a0738b7f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:19.612459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:19.613079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:19.613362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:19.613635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:19.623412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:12:19.628048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:12:19.629155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:12:19.630347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 588/1188] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:12:19.635735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e02bf-c3a2-4641-b808-218e3ac9ed49 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:19.690180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:19.732848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e02bf-c3a2-4641-b808-218e3ac9ed49 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:19.765082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:19.765681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:19.765964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:19.766239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:19.766896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:19.767204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:19.768589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:19.777280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 601/1189] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:12:19.783018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:19.881202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e87ab-90f7-4a47-9ce2-d3b84d409db1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:19.882718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:19.916094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:19.916740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:19.917135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:19.917415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] PATH_INFO: `/v3/users/7f773fe589194ceaa5bd879a574e0327` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:19.918532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] RBAC: Authorizing `identity:get_user(user_id=7f773fe589194ceaa5bd879a574e0327)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:19.919956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:19.921557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 589/1190] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:12:19 2022] GET /identity/v3/users/7f773fe589194ceaa5bd879a574e0327 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:12:19.927362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:20.024004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c169e-9272-42a2-8555-228e4809e475 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:20.041843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:20.057963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f86d77-3e58-4801-94a3-f2c4ba7529a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:20.058589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f86d77-3e58-4801-94a3-f2c4ba7529a4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:20.058874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f86d77-3e58-4801-94a3-f2c4ba7529a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:20.059152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f86d77-3e58-4801-94a3-f2c4ba7529a4 None admin] PATH_INFO: `/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:20.060286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f86d77-3e58-4801-94a3-f2c4ba7529a4 None admin] RBAC: Authorizing `identity:get_project(project_id=9dd6eb9d501b41e0b5c06f4d6301f159)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:20.061739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f86d77-3e58-4801-94a3-f2c4ba7529a4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:20.063357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 602/1191] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:12:19 2022] GET /identity/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:20.069316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:20.166541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05400a-a514-4424-bf97-123f05c427d3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:20.199982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc113b-04cd-474b-8ea4-5d4c5325db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:20.200648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc113b-04cd-474b-8ea4-5d4c5325db49 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:20.200930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc113b-04cd-474b-8ea4-5d4c5325db49 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:20.201203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc113b-04cd-474b-8ea4-5d4c5325db49 None admin] PATH_INFO: `/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159/users/7f773fe589194ceaa5bd879a574e0327/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:20.203098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc113b-04cd-474b-8ea4-5d4c5325db49 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dd6eb9d501b41e0b5c06f4d6301f159, user_id=7f773fe589194ceaa5bd879a574e0327, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:20.204569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc113b-04cd-474b-8ea4-5d4c5325db49 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:20.291364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 590/1192] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:12:20 2022] PUT /identity/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159/users/7f773fe589194ceaa5bd879a574e0327/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:12:22.141658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc012-4fcc-4b3f-921b-9e1cf4f36b70 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:22.142209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc012-4fcc-4b3f-921b-9e1cf4f36b70 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:22.142209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc012-4fcc-4b3f-921b-9e1cf4f36b70 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:22.143546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 603/1193] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:12:22.148904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b247ad-a955-4622-ae46-dc020fdba7b6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:22.149322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b247ad-a955-4622-ae46-dc020fdba7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:22.149667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b247ad-a955-4622-ae46-dc020fdba7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:22.167506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-86b247ad-a955-4622-ae46-dc020fdba7b6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:12:22.168723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86b247ad-a955-4622-ae46-dc020fdba7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:12:22.192156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:22.234704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 591/1194] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:12:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:12:22.507618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bc012-4fcc-4b3f-921b-9e1cf4f36b70 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:22.607411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bc012-4fcc-4b3f-921b-9e1cf4f36b70 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:22.641018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:22.641697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:22.641984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:22.642277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:22.652296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:12:22.657105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:12:22.658183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:12:22.659213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 604/1195] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:12:22.665216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b247ad-a955-4622-ae46-dc020fdba7b6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:22.761479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b247ad-a955-4622-ae46-dc020fdba7b6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:22.794906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:22.795502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:22.795783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:22.796063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:22.796744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:22.797046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:22.798407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:22.806187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 592/1196] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:22.811929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:22.858622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:22.910739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e82c60-6195-46c4-aff0-27897fae9e50 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:22.944985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:22.945611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:22.945920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:22.946366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] PATH_INFO: `/v3/users/7f773fe589194ceaa5bd879a574e0327` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:22.947621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] RBAC: Authorizing `identity:get_user(user_id=7f773fe589194ceaa5bd879a574e0327)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:22.949066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:22.950623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 605/1197] 10.222.0.86 () {56 vars in 1177 bytes} [Thu Aug 18 11:12:22 2022] GET /identity/v3/users/7f773fe589194ceaa5bd879a574e0327 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:22.956541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:22.981764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:23.056056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600cfe-e0b2-4609-a838-4e91bff648c2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:23.088481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:23.089071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:23.089350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:23.089618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:23.154743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:23.156177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:23.178281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:23.251806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 593/1198] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:12:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:12:23.257930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:23.356182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bfbc3-5c22-463e-9a12-cbd20534562c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:23.369032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:23.388661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e2705-cb14-48f3-b681-e8daba1ec73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:23.389283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e2705-cb14-48f3-b681-e8daba1ec73c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:23.389560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e2705-cb14-48f3-b681-e8daba1ec73c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:23.389830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e2705-cb14-48f3-b681-e8daba1ec73c None admin] PATH_INFO: `/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:23.390924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e2705-cb14-48f3-b681-e8daba1ec73c None admin] RBAC: Authorizing `identity:get_project(project_id=9dd6eb9d501b41e0b5c06f4d6301f159)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:23.392476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e2705-cb14-48f3-b681-e8daba1ec73c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:23.394078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 606/1199] 10.222.0.86 () {56 vars in 1186 bytes} [Thu Aug 18 11:12:23 2022] GET /identity/v3/projects/9dd6eb9d501b41e0b5c06f4d6301f159 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:23.401042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:12:23.497453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1652-0b71-4729-b7fd-f57c0dfa50ed None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:12:23.519875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:23.531781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0de58-72b7-424d-9f6d-af011b088b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:12:23.534681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0de58-72b7-424d-9f6d-af011b088b06 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:12:23.534681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0de58-72b7-424d-9f6d-af011b088b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:12:23.534681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0de58-72b7-424d-9f6d-af011b088b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:12:23.534681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0de58-72b7-424d-9f6d-af011b088b06 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=9dd6eb9d501b41e0b5c06f4d6301f159, user.id=7f773fe589194ceaa5bd879a574e0327) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:12:23.534681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0de58-72b7-424d-9f6d-af011b088b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:12:23.535663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0de58-72b7-424d-9f6d-af011b088b06 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:12:23.541383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 594/1200] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:12:23 2022] GET /identity/v3/role_assignments?user.id=7f773fe589194ceaa5bd879a574e0327&scope.project.id=9dd6eb9d501b41e0b5c06f4d6301f159&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:12:33.398797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=9 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:12:33.554044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:36.155405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc8a9-df30-45cb-9e79-d02924c02d51 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:36.155993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc8a9-df30-45cb-9e79-d02924c02d51 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:36.156096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc8a9-df30-45cb-9e79-d02924c02d51 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:36.157692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 607/1201] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:13:36.162905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d417a-c3ab-4c88-ba31-d09ee8c8f04b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:36.163345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d417a-c3ab-4c88-ba31-d09ee8c8f04b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:36.163455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d417a-c3ab-4c88-ba31-d09ee8c8f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:36.182611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ce2d417a-c3ab-4c88-ba31-d09ee8c8f04b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:36.183754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ce2d417a-c3ab-4c88-ba31-d09ee8c8f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:36.249803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 595/1202] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:13:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:13:36.519452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bc8a9-df30-45cb-9e79-d02924c02d51 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:36.621985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bc8a9-df30-45cb-9e79-d02924c02d51 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:36.655704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:36.656408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:36.656964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:36.657241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:36.667732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:36.671299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:36.684150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:36.685399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:36.686568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:36.686568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:36.686568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:36.686568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 608/1203] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:36.691422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d417a-c3ab-4c88-ba31-d09ee8c8f04b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:36.789075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d417a-c3ab-4c88-ba31-d09ee8c8f04b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:36.818022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:36.823475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3ea1e-f6ee-4d1f-85da-932069f138c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:36.824135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ea1e-f6ee-4d1f-85da-932069f138c8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:36.824466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ea1e-f6ee-4d1f-85da-932069f138c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:36.824779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3ea1e-f6ee-4d1f-85da-932069f138c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:36.825379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3ea1e-f6ee-4d1f-85da-932069f138c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:36.825681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3ea1e-f6ee-4d1f-85da-932069f138c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:36.827058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3ea1e-f6ee-4d1f-85da-932069f138c8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:36.839008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 596/1204] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:36.844846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:36.896872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:36.943050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868a57-6d8b-43c1-bd9b-7f6c911f6dbc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:36.976110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b6a2f-a0d2-4a74-a73a-b8297add76cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:36.976731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b6a2f-a0d2-4a74-a73a-b8297add76cf None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:36.977661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b6a2f-a0d2-4a74-a73a-b8297add76cf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:36.978064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b6a2f-a0d2-4a74-a73a-b8297add76cf None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:36.978698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b6a2f-a0d2-4a74-a73a-b8297add76cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:36.980113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b6a2f-a0d2-4a74-a73a-b8297add76cf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:37.084344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 609/1205] 10.222.0.86 () {60 vars in 1132 bytes} [Thu Aug 18 11:13:36 2022] POST /identity/v3/users => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:13:39.006279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b392bb-1412-44da-bbf1-52dc833d9f32 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:39.006882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b392bb-1412-44da-bbf1-52dc833d9f32 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:39.006882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b392bb-1412-44da-bbf1-52dc833d9f32 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:39.008531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 597/1206] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:13:39.013679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b4c3-678b-46f3-96d2-c7dbdef4b97a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:39.014111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b4c3-678b-46f3-96d2-c7dbdef4b97a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:39.014212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b4c3-678b-46f3-96d2-c7dbdef4b97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:39.032420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e117b4c3-678b-46f3-96d2-c7dbdef4b97a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:39.033608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e117b4c3-678b-46f3-96d2-c7dbdef4b97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:39.099516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 610/1207] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:13:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:13:39.370890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b392bb-1412-44da-bbf1-52dc833d9f32 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:39.471169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b392bb-1412-44da-bbf1-52dc833d9f32 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:39.504355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:39.504979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:39.505261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:39.505538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:39.516790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:13:39.521473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:39.522610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:39.523845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 598/1208] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:13:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:39.528841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b4c3-678b-46f3-96d2-c7dbdef4b97a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:39.568879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:39.627061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b4c3-678b-46f3-96d2-c7dbdef4b97a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:39.662121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:39.662739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:39.663023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:39.663301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:39.663974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:39.664366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:39.671723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:39.674798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 611/1209] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:39.681167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:39.734584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:39.784606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa226c83-062a-450e-8baa-0940bf8be35c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:39.817903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:39.818523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:39.818804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:39.819077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:39.829316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:39.830789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:39.844472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:39.845623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:39.846565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:39.846565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:39.846565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:39.846565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 599/1210] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:39.851515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:39.951301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:39.954161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba24f0-5930-41a4-9dcb-c7618fd0ae94 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:39.988022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:39.988664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:39.988951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:39.989247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:39.989941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:39.990235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:39.991598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:40.002599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 612/1211] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:40.008643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:40.112270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7266-364b-4991-b9b9-e121baa9f407 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:40.113893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:40.145170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:40.146470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:40.146752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:40.147677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:40.157022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:40.158452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:13:40.170132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:40.174157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:40.175113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 600/1212] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:40.177323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:40.278562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f61be0-d936-45d5-bd72-7ffa34fc19ef None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:40.312227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:40.312857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:40.313118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:40.313394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:40.314112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:40.314418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:40.315830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:40.333452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 613/1213] 10.222.0.86 () {56 vars in 1143 bytes} [Thu Aug 18 11:13:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:40.339798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:40.438015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8a5e-a5b8-4771-a4ac-fedfd3281abb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:40.472245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:40.472791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:40.473074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:40.473349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:40.502162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:40.539855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:40.541327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:40.642345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 601/1214] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:13:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:13:40.648302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:40.667717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:40.747997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ee178-184c-4af9-85dc-6a2077bd9e5a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:40.781145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:40.782020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:40.782301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:40.782573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:40.792490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:40.793982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:40.813500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:40.814598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:40.815599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:40.815599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:40.815599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:40.815599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 614/1215] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:40.820465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:40.881191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:40.918850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e1422-f3e1-4a3e-aab9-3e8e3c1a6bc1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:40.952617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:40.953222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:40.953497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:40.953769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:40.954411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:40.954713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:40.956069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:40.967879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 602/1216] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:40.973585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:41.042677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:41.075032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79701b-2d4c-4e5a-b495-d8c880b34593 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:41.108199 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:41.108890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:41.114647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:41.114647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:41.115918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:41.117385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:13:41.128907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:41.129957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:41.131036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 615/1217] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:13:41.136200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:41.237182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593a70-be98-4a28-b130-7ccf1bcbe361 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:41.260112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:41.271529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc15b3-523f-49f8-830d-1117ef28bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:41.272149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc15b3-523f-49f8-830d-1117ef28bd1b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:41.272458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc15b3-523f-49f8-830d-1117ef28bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:41.272739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc15b3-523f-49f8-830d-1117ef28bd1b None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:41.273439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc15b3-523f-49f8-830d-1117ef28bd1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:41.273784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc15b3-523f-49f8-830d-1117ef28bd1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:41.275440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc15b3-523f-49f8-830d-1117ef28bd1b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:41.287300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 603/1218] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:41.294224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:41.393414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e78d-4e46-4c9f-aefc-1198bc856804 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:41.422077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:41.427712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d53059-199a-4ada-9f8a-f3c112c30dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:41.428335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53059-199a-4ada-9f8a-f3c112c30dbb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:41.428615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53059-199a-4ada-9f8a-f3c112c30dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:41.428886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53059-199a-4ada-9f8a-f3c112c30dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:41.429599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d53059-199a-4ada-9f8a-f3c112c30dbb None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=69dfae99c30d4a2a89199a3da610b8bb) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:41.429996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d53059-199a-4ada-9f8a-f3c112c30dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:41.431623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d53059-199a-4ada-9f8a-f3c112c30dbb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:41.436852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 616/1219] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:13:41 2022] GET /identity/v3/role_assignments?user.id=69dfae99c30d4a2a89199a3da610b8bb&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:43.334988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438020-c8a0-4e0a-93f9-b2804135f625 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:43.335513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438020-c8a0-4e0a-93f9-b2804135f625 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:43.335606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438020-c8a0-4e0a-93f9-b2804135f625 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:43.337498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 604/1220] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:13:43.342543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eb6a4-77f3-419e-9f5f-372b6ad342ff None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:43.342937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eb6a4-77f3-419e-9f5f-372b6ad342ff None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:43.343098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eb6a4-77f3-419e-9f5f-372b6ad342ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:43.360867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-007eb6a4-77f3-419e-9f5f-372b6ad342ff None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:43.362122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-007eb6a4-77f3-419e-9f5f-372b6ad342ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:43.427970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 617/1221] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:13:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:13:43.700912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438020-c8a0-4e0a-93f9-b2804135f625 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:43.799649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438020-c8a0-4e0a-93f9-b2804135f625 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:43.833140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:43.833758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:43.834032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:43.834301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:43.844651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:13:43.849191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:43.850335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:43.851340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 605/1222] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:13:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:43.857118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eb6a4-77f3-419e-9f5f-372b6ad342ff None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:43.955485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eb6a4-77f3-419e-9f5f-372b6ad342ff None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:43.979433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:43.989916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:43.990522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:43.990806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:43.991089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:43.991754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:43.992061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:43.993508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:44.001304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 618/1223] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:13:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:44.007150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:44.050542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:44.105683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8830f-5704-423e-8dfd-0554460616ab None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:44.138191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:44.138804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:44.139082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:44.139356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:44.150282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:44.151842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:44.165642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:44.166759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:44.167696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:44.167696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:44.167696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:44.167696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 606/1224] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:44.172767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:44.274694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dd083-5ee5-4add-9e2b-e8edcf475fea None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:44.307317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:44.307920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:44.308202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:44.308506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:44.309145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:44.309449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:44.310792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:44.322745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 619/1225] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:44.328629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:44.420649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:44.427138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61926-29d7-494e-9afc-0a722a2befe6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:44.460095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:44.460688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:44.460970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:44.461265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:44.468470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:44.469955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:13:44.480764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:44.482026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:44.483379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 607/1226] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:44.487724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:44.534717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:44.585955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d418e-a276-4b7b-a5e5-ac481f281bbe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:44.618604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:44.619238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:44.619522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:44.619795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:44.620549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:44.620856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:44.622312 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:44.639376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 620/1227] 10.222.0.86 () {56 vars in 1143 bytes} [Thu Aug 18 11:13:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:44.645406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:44.746397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200190-7db0-462a-bfd6-d802ee84326b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:44.780036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:44.780699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:44.780984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:44.781516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:44.792378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:44.793811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:44.808147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:44.814178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:44.815269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:44.815269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:44.815269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:44.815269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 608/1228] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:44.815574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:44.915577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e5e63-b128-4d59-877e-3a306206e03d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:44.917883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:44.950041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:44.950646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:44.950930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:44.951204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:44.951845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:44.952150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:44.953536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:44.965116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 621/1229] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:44.970781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:44.980098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:45.071341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f9012-731b-453a-a86a-d1eb421b4ab2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:45.105729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:45.115106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:45.115106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:45.115106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:45.115106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:45.115106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:13:45.126967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:45.128171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:45.129103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 609/1230] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:45.134713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:45.234624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912189a-bc8f-4881-b288-74ebe2cafff0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:45.268750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4134-7c88-4ef7-9251-859a4d4f9e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:45.269412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4134-7c88-4ef7-9251-859a4d4f9e8d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:45.269704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4134-7c88-4ef7-9251-859a4d4f9e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:45.269982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4134-7c88-4ef7-9251-859a4d4f9e8d None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:45.270673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4134-7c88-4ef7-9251-859a4d4f9e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:45.270981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4134-7c88-4ef7-9251-859a4d4f9e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:45.272430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4134-7c88-4ef7-9251-859a4d4f9e8d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:45.284790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 622/1231] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:13:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:45.291234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:45.356793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:45.391140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd6f5a-99fd-4be0-813b-6cee099abc1f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:45.423999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb308ec-30de-486a-a13c-d9d9d977573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:45.424684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb308ec-30de-486a-a13c-d9d9d977573c None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:45.424966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb308ec-30de-486a-a13c-d9d9d977573c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:45.425243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb308ec-30de-486a-a13c-d9d9d977573c None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/69dfae99c30d4a2a89199a3da610b8bb/roles/6cb47f6dfcc046b9b43619b5f16931ad` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:45.439814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb308ec-30de-486a-a13c-d9d9d977573c None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=69dfae99c30d4a2a89199a3da610b8bb, role_id=6cb47f6dfcc046b9b43619b5f16931ad)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:45.441280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb308ec-30de-486a-a13c-d9d9d977573c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:45.515978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 610/1232] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:13:45 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/69dfae99c30d4a2a89199a3da610b8bb/roles/6cb47f6dfcc046b9b43619b5f16931ad => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:13:47.400692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668e0a-7427-49ed-a4a2-109f586053fd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:47.401234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668e0a-7427-49ed-a4a2-109f586053fd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:47.401234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668e0a-7427-49ed-a4a2-109f586053fd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:47.402543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 623/1233] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:13:47.407776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7cbf5-5221-48cb-8dc2-f43f871ba444 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:47.408166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7cbf5-5221-48cb-8dc2-f43f871ba444 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:47.408359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7cbf5-5221-48cb-8dc2-f43f871ba444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:47.426769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1ef7cbf5-5221-48cb-8dc2-f43f871ba444 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:47.427944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ef7cbf5-5221-48cb-8dc2-f43f871ba444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:47.494606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 611/1234] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:13:47.766748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1668e0a-7427-49ed-a4a2-109f586053fd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:47.792506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:47.866911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1668e0a-7427-49ed-a4a2-109f586053fd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:47.901810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:47.902432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:47.902708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:47.902992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:47.913687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:13:47.919238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:47.920651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:47.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 624/1235] 10.222.0.86 () {56 vars in 1102 bytes} [Thu Aug 18 11:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:47.926405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7cbf5-5221-48cb-8dc2-f43f871ba444 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:47.972334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:48.024157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7cbf5-5221-48cb-8dc2-f43f871ba444 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:48.059483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:48.060090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:48.060407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:48.060686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:48.061348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:48.061654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:48.063031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:48.071465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 612/1236] 10.222.0.86 () {56 vars in 1103 bytes} [Thu Aug 18 11:13:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:48.076831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:48.162665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:48.178807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4bc5-1341-4a2c-977b-a733675ce56c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:48.212455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:48.213085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:48.213367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:48.213642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:48.223832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:48.225320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:48.240966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:48.242176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:48.243444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:48.243444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:48.243444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:48.243444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 625/1237] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:48.248351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:48.348577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d30a39-cd54-4e1f-8220-2d113fd8c084 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:48.358069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:48.382131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:48.382777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:48.383188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:48.383469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:48.384111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:48.384446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:48.385807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:48.397101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 613/1238] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:13:48.403519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:48.501909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17088c9a-06eb-4433-8ae5-0f9610e3d307 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:48.536582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:48.537142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:48.537440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:48.537744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:48.541144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:48.545525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:48.546964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:13:48.558155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:48.559255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:48.560198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 626/1239] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:48.565021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:48.665946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18705-331a-40e8-acc3-1a4e1c0e694c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:48.699872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:48.700504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:48.700785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:48.701057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:48.701784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:48.702091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:48.703520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:48.720017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 614/1240] 10.222.0.86 () {56 vars in 1143 bytes} [Thu Aug 18 11:13:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:48.725850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:48.826699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c091416-77a1-4d9d-9147-45b9f21779b6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:48.859481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:48.860082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:48.860396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:48.860672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:48.921506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:48.928194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:48.929808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:49.027799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 627/1241] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:13:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:13:49.034139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:49.062017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:49.134219 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3424868-6286-470e-ad74-c0a4bfc19b7c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:49.169202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:49.169828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:49.170108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:49.170379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:49.180635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:49.181794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:49.196102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:49.198980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:49.200102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:49.200102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:49.200102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:49.200102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 615/1242] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:49.203346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:49.297711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:49.303529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d0cf-5bf1-4b76-aab3-b96261a27c11 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:49.336813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:49.337415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:49.337695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:49.337981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:49.338610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:49.338912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:49.340278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:49.351075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 628/1243] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:49.357009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:49.435320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:49.457170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3991bae-9547-4e0a-be39-8a36c2506def None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:49.490637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:49.491264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:49.491544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:49.491825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:49.498684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:49.500113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:13:49.511734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:49.512779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:49.513834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 616/1244] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:49.518975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:49.619281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f55999-43a5-4e38-9aca-b5b80bda9a10 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:49.653682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d7dc1-3a61-41d3-be82-869894608559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:49.654280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d7dc1-3a61-41d3-be82-869894608559 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:49.654562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d7dc1-3a61-41d3-be82-869894608559 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:49.654837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d7dc1-3a61-41d3-be82-869894608559 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:49.655530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d7dc1-3a61-41d3-be82-869894608559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:49.655840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d7dc1-3a61-41d3-be82-869894608559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:49.657582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d7dc1-3a61-41d3-be82-869894608559 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:49.669838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 629/1245] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:13:49.676016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:49.775720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77878313-87d1-4398-bb7a-3c49d8594221 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:49.809297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b130ec2-0aa5-430f-9143-bc99cbdeef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:49.809890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ec2-0aa5-430f-9143-bc99cbdeef13 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:49.810167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ec2-0aa5-430f-9143-bc99cbdeef13 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:49.810437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ec2-0aa5-430f-9143-bc99cbdeef13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:49.811157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b130ec2-0aa5-430f-9143-bc99cbdeef13 None admin] RBAC: Adding query filter params (role.id=6cb47f6dfcc046b9b43619b5f16931ad, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=69dfae99c30d4a2a89199a3da610b8bb) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:49.811463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b130ec2-0aa5-430f-9143-bc99cbdeef13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:49.812931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b130ec2-0aa5-430f-9143-bc99cbdeef13 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:49.818575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 617/1246] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:13:49 2022] GET /identity/v3/role_assignments?user.id=69dfae99c30d4a2a89199a3da610b8bb&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=6cb47f6dfcc046b9b43619b5f16931ad => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:13:51.775969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcc3a3-a571-46aa-bd43-ae9f0b8e39a8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:51.776559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcc3a3-a571-46aa-bd43-ae9f0b8e39a8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:51.776559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcc3a3-a571-46aa-bd43-ae9f0b8e39a8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:51.777908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 630/1247] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:13:51.783369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d5b0-b96e-4a42-bedf-24d698bfd1e8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:51.783790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d5b0-b96e-4a42-bedf-24d698bfd1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:51.783929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d5b0-b96e-4a42-bedf-24d698bfd1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:51.790766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:51.802574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f4e3d5b0-b96e-4a42-bedf-24d698bfd1e8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:51.803771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f4e3d5b0-b96e-4a42-bedf-24d698bfd1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:51.872457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 618/1248] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:13:52.141623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcc3a3-a571-46aa-bd43-ae9f0b8e39a8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:52.160475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:52.247305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcc3a3-a571-46aa-bd43-ae9f0b8e39a8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:52.282544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:52.283163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:52.283447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:52.283719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:52.294334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:13:52.298940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:52.300123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:52.301140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 631/1249] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:52.306317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d5b0-b96e-4a42-bedf-24d698bfd1e8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:52.406335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d5b0-b96e-4a42-bedf-24d698bfd1e8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:52.434827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:52.439541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:52.440145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:52.440459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:52.440729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:52.441389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:52.441689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:52.443039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:52.451552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 619/1250] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:52.457499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:52.534081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:52.556398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e23cbc-a949-4067-9d14-9c9296ca9884 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:52.590256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:52.590873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:52.591151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:52.591422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:52.601058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:52.602498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:52.616951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:52.618316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:52.619442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:52.619442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:52.619442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:52.619442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 632/1251] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:52.624228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:52.722666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ed156-17bd-4ee2-835e-db4338ebc475 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:52.755983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:52.756611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:52.756898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:52.757169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:52.758425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:52.758725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:52.760076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:52.771564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 620/1252] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:13:52.777645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:52.876506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154384f-6371-4c6b-868f-152c9d9c8dfa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:52.902977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:52.910948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:52.911569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:52.911850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:52.912125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:52.919896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:52.921809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:13:52.933284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:52.934400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:52.935441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 633/1253] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:13:52.940435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:53.002197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:53.046235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937933bc-4979-4720-a6b5-14520fcb5391 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:53.082737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:53.083730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:53.084202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:53.084707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:53.086007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:53.086411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:53.088172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:53.106764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 621/1254] 10.222.0.86 () {56 vars in 1143 bytes} [Thu Aug 18 11:13:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:53.112931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:53.225967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0aff-c768-4c68-8999-917077a09c7f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:53.270363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:53.270893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:53.271173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:53.271444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:53.342726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:53.356413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:53.357856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:53.469347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 634/1255] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:13:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:13:53.475268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:53.589333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a147cba-623c-46e1-9fe2-b5b375afe0b6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:53.603910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:53.629332 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:53.629973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:53.630259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:53.630533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:53.641487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:53.642968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:53.659634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:53.660815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:53.662052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:53.662052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:53.662052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:53.662052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 622/1256] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:53.667269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:53.773718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:53.787485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae26e-f12b-47fe-9954-a2340a0f323a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:53.826287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:53.826896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:53.827179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:53.827454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:53.828146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:53.828490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:53.829850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:53.842430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 635/1257] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:53.847767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:53.957259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d78ca-6176-4c9f-8ea5-e5d958080bc7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:53.995490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:53.996136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:53.996443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:53.996714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:54.003691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:54.006389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:13:54.018798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:54.019898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:13:54.020888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 623/1258] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:54.026051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:54.127010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a2be-1f17-436d-b7fa-301ba5f16051 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:54.160472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7bc4-c03f-486f-878c-b54c4cd24d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:54.161097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7bc4-c03f-486f-878c-b54c4cd24d62 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:54.161405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7bc4-c03f-486f-878c-b54c4cd24d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:54.161684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7bc4-c03f-486f-878c-b54c4cd24d62 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:54.162399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7bc4-c03f-486f-878c-b54c4cd24d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:54.162709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7bc4-c03f-486f-878c-b54c4cd24d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:54.164800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7bc4-c03f-486f-878c-b54c4cd24d62 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:54.176888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 636/1259] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:54.183458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:54.209409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:54.284990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47cd6-81d5-4122-aa9e-a3b23749ac14 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:54.319188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba682d-092f-44d9-8f8c-866384f69fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:54.319798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba682d-092f-44d9-8f8c-866384f69fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:54.320080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba682d-092f-44d9-8f8c-866384f69fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:54.320389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba682d-092f-44d9-8f8c-866384f69fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:54.321264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba682d-092f-44d9-8f8c-866384f69fb5 None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=69dfae99c30d4a2a89199a3da610b8bb) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:54.321581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba682d-092f-44d9-8f8c-866384f69fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:54.323010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba682d-092f-44d9-8f8c-866384f69fb5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:54.328378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 624/1260] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:13:54 2022] GET /identity/v3/role_assignments?user.id=69dfae99c30d4a2a89199a3da610b8bb&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=e15e6a68b97848f894a24857503ceab4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:56.212692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa439d2-775c-4b73-92ef-2c5c2aff77e5 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:56.213260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa439d2-775c-4b73-92ef-2c5c2aff77e5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:56.213260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa439d2-775c-4b73-92ef-2c5c2aff77e5 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:56.214670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 637/1261] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:13:56.219931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5875-fa2f-49f7-ba02-16a9e6da1195 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:56.220362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5875-fa2f-49f7-ba02-16a9e6da1195 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:56.222214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5875-fa2f-49f7-ba02-16a9e6da1195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:56.239416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4aaf5875-fa2f-49f7-ba02-16a9e6da1195 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:13:56.240781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4aaf5875-fa2f-49f7-ba02-16a9e6da1195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:13:56.308230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 625/1262] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:13:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:13:56.576508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa439d2-775c-4b73-92ef-2c5c2aff77e5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:56.587915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:56.676335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa439d2-775c-4b73-92ef-2c5c2aff77e5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:56.711855 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:56.712506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:56.712793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:56.713056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:56.722832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:13:56.727465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:56.728659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:56.733232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 638/1263] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:13:56.734897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5875-fa2f-49f7-ba02-16a9e6da1195 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:56.753561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:56.837186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5875-fa2f-49f7-ba02-16a9e6da1195 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:56.870939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:56.871547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:56.871832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:56.872110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:56.872814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:56.873122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:56.874500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:56.882914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 626/1264] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:56.888909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:56.957046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:56.990486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746fa8-82c2-4889-bf94-9ccd426af170 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:57.028736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:57.029415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:57.029699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:57.029999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:57.041501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:57.042936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:57.056885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:57.058033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:57.059113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:57.059113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:57.059113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:57.059113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 639/1265] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:57.063805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:57.145909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:57.165444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499868cf-6d68-4da4-9689-944913cf39c4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:57.199101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:57.199707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:57.199991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:57.200348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:57.200979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:57.201281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:57.202755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:57.214640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 627/1266] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:57.220333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:57.322584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a707a16-c00f-4ffa-a243-2990caa8ec66 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:57.341586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:57.355484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:57.356109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:57.356431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:57.356708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:57.363944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:57.365409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:13:57.376950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:57.378037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:57.379113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 640/1267] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:57.384689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:57.483417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea6e6b-7dfe-4ec3-b534-9cdb28b4bc5c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:57.519095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:57.519696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:57.519974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:57.520314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:57.521033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:57.521346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:57.522801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:57.532614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:57.541711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 628/1268] 10.222.0.86 () {56 vars in 1143 bytes} [Thu Aug 18 11:13:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:57.547408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:57.645760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cec72-aa5c-4ff6-9f62-b6bb8bb98c7e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:57.679206 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:57.680043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:57.680354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:57.680651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:57.691946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:57.693454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:13:57.708238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:57.709498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:13:57.711205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:13:57.711205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:13:57.711205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:57.711205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 641/1269] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:57.715790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:57.815091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bfebb-a90e-43b2-8aff-9c998c4b83ab None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:57.850051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:57.850649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:57.850926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:57.851225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:57.851937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:57.852264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:57.853629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:57.867738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 629/1270] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:57.873631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:57.906425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:57.971772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de203ed-2e20-4824-93ff-21b9e7466dec None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:58.008954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:58.009572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:58.009854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:58.010126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:58.016609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:58.018025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:13:58.029161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:13:58.032916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:13:58.034027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 642/1271] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:13:58.036598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:58.096712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:58.138591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e1b35-cfea-4e99-aa10-6651c02055be None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:58.172202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb9352-13f5-4a21-977e-ff3d2411bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:58.172838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb9352-13f5-4a21-977e-ff3d2411bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:58.173119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb9352-13f5-4a21-977e-ff3d2411bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:58.173393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb9352-13f5-4a21-977e-ff3d2411bdd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:58.174085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb9352-13f5-4a21-977e-ff3d2411bdd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:13:58.174394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb9352-13f5-4a21-977e-ff3d2411bdd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:58.175923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb9352-13f5-4a21-977e-ff3d2411bdd5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:58.187584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 630/1272] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:13:58.193662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:13:58.286194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:13:58.294714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2eba-0f4c-40fb-b447-c7d5bcd683ca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:13:58.327836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb996889-6c7c-4d39-bbfa-a7dfe5310f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:13:58.328510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb996889-6c7c-4d39-bbfa-a7dfe5310f0b None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:13:58.328797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb996889-6c7c-4d39-bbfa-a7dfe5310f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:13:58.329074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb996889-6c7c-4d39-bbfa-a7dfe5310f0b None admin] PATH_INFO: `/v3/projects/b002c61ded604953bd192ac248b1ae18/users/69dfae99c30d4a2a89199a3da610b8bb/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:13:58.330941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb996889-6c7c-4d39-bbfa-a7dfe5310f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=b002c61ded604953bd192ac248b1ae18, user_id=69dfae99c30d4a2a89199a3da610b8bb, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:13:58.332433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb996889-6c7c-4d39-bbfa-a7dfe5310f0b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:13:58.441620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 643/1273] 10.222.0.86 () {58 vars in 1439 bytes} [Thu Aug 18 11:13:58 2022] PUT /identity/v3/projects/b002c61ded604953bd192ac248b1ae18/users/69dfae99c30d4a2a89199a3da610b8bb/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:14:00.340026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647c0d-40ea-475c-a5e9-9449c32a3fd4 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:00.340703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647c0d-40ea-475c-a5e9-9449c32a3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:00.340800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647c0d-40ea-475c-a5e9-9449c32a3fd4 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:00.342065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 631/1274] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:14:00.347376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade08bc1-0eed-47db-941c-995ea374e124 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:00.347769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade08bc1-0eed-47db-941c-995ea374e124 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:00.347938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade08bc1-0eed-47db-941c-995ea374e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:00.365626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ade08bc1-0eed-47db-941c-995ea374e124 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:00.367499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ade08bc1-0eed-47db-941c-995ea374e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:00.433028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 644/1275] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:14:00.703521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9647c0d-40ea-475c-a5e9-9449c32a3fd4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:00.808040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9647c0d-40ea-475c-a5e9-9449c32a3fd4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:00.825844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:00.842846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:00.843474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:00.843756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:00.844029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:00.853810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 11:14:00.858675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:00.864397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:00.865561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 632/1276] 10.222.0.86 () {56 vars in 1096 bytes} [Thu Aug 18 11:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:14:00.866458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade08bc1-0eed-47db-941c-995ea374e124 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:00.947046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:00.964460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade08bc1-0eed-47db-941c-995ea374e124 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:00.996526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:00.997123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:00.997404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:00.997675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:00.998324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:00.998623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:00.999959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:01.008511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 645/1277] 10.222.0.86 () {56 vars in 1099 bytes} [Thu Aug 18 11:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:01.015194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:01.113858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3ef0-09e6-4eba-923a-e3bbfeae51c4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:01.148031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:01.148688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:01.148973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:01.149252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:01.159585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:01.161149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:14:01.176437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:01.178061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:14:01.179656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:14:01.179656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:14:01.179656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:01.179656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 633/1278] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 11:14:01.186257 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:01.290496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff651b-2bb2-495d-a0d5-97be05fc110f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:01.323503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:01.324101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:01.324412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:01.324683 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:01.325326 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:01.325626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:01.326966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:01.340425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 646/1279] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:01.346450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:01.377969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:01.448579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875c205-cdf2-4f82-a501-bdb01bd565e0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:01.482380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:01.483017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:01.483299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:01.483574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:01.491022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:01.493147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 11:14:01.504023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:01.508101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:01.509377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 634/1280] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:14:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:14:01.511635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:01.515490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:01.612280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a4b4-68a6-4231-9644-af3c194d0d8a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:01.645952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:01.646561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:01.646848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:01.647126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:01.648620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:01.649053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:01.650416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:01.668390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 647/1281] 10.222.0.86 () {56 vars in 1143 bytes} [Thu Aug 18 11:14:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:01.674370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:01.766686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:01.776615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de27e74-0bb2-45cc-911a-261588c4cb49 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:01.811436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:01.812046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:01.812356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:01.812630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:01.883619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:01.885138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:01.973722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:01.984526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 635/1282] 10.222.0.86 () {58 vars in 1282 bytes} [Thu Aug 18 11:14:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 11:14:01.990542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:02.055357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:02.093482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf241cf-1a12-4eaa-9daa-0bb2afefc6b6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:02.131029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:02.131893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:02.132724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:02.133084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:02.145525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:02.146923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 11:14:02.164739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:02.167336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 11:14:02.168478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 11:14:02.168478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 11:14:02.168478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:14:02.168478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 648/1283] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:14:02.172038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:02.284226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c506d-9d62-4332-8c80-cf5c1c5bc0bb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:02.321200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:02.321950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:02.322233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:02.322532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:02.323210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:02.323519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:02.324972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:02.338730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 636/1284] 10.222.0.86 () {56 vars in 1109 bytes} [Thu Aug 18 11:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:02.344479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:02.451068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26bd08-b6fd-486f-96ea-dfcd4fd8cf8d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:02.465299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:02.485445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:02.486078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:02.486364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:02.486641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:02.493812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:02.495259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 11:14:02.506525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:02.508640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 18 11:14:02.509564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 649/1285] 10.222.0.86 () {56 vars in 1111 bytes} [Thu Aug 18 11:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:14:02.515186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:02.567992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:02.620548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33af6-5965-402b-acbd-5998a32858e5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:02.654057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a12dc5-4177-4633-afb7-f67864bc24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:02.654656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a12dc5-4177-4633-afb7-f67864bc24dc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:02.654934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a12dc5-4177-4633-afb7-f67864bc24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:02.655202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a12dc5-4177-4633-afb7-f67864bc24dc None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:02.656140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a12dc5-4177-4633-afb7-f67864bc24dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:02.656467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a12dc5-4177-4633-afb7-f67864bc24dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:02.657956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a12dc5-4177-4633-afb7-f67864bc24dc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:02.669943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 637/1286] 10.222.0.86 () {56 vars in 1148 bytes} [Thu Aug 18 11:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:14:02.676032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:02.775597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead15a-9b9a-42a7-9b65-36d83d6a1307 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:02.809258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114ce05-c497-4634-b668-9f9fe093c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:02.810276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114ce05-c497-4634-b668-9f9fe093c7cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:02.810276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114ce05-c497-4634-b668-9f9fe093c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:02.810479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114ce05-c497-4634-b668-9f9fe093c7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:02.811155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114ce05-c497-4634-b668-9f9fe093c7cd None admin] RBAC: Adding query filter params (role.id=e15e6a68b97848f894a24857503ceab4, scope.project.id=b002c61ded604953bd192ac248b1ae18, user.id=69dfae99c30d4a2a89199a3da610b8bb) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:02.811471 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114ce05-c497-4634-b668-9f9fe093c7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:02.812932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114ce05-c497-4634-b668-9f9fe093c7cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:02.818523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 650/1287] 10.222.0.86 () {56 vars in 1374 bytes} [Thu Aug 18 11:14:02 2022] GET /identity/v3/role_assignments?user.id=69dfae99c30d4a2a89199a3da610b8bb&scope.project.id=b002c61ded604953bd192ac248b1ae18&role.id=e15e6a68b97848f894a24857503ceab4 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:04.737163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a1d62-f86c-4602-b205-f05ea5ce929a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:04.737698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a1d62-f86c-4602-b205-f05ea5ce929a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:04.737698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a1d62-f86c-4602-b205-f05ea5ce929a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:04.739030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 638/1288] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:14:04.745077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378d01-6215-4231-bcf8-a3d4f1bf6a01 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:04.745496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378d01-6215-4231-bcf8-a3d4f1bf6a01 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:04.752294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45378d01-6215-4231-bcf8-a3d4f1bf6a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:04.764339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-45378d01-6215-4231-bcf8-a3d4f1bf6a01 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:04.765551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-45378d01-6215-4231-bcf8-a3d4f1bf6a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:04.795072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:04.831959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 651/1289] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:14:05.098610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a1d62-f86c-4602-b205-f05ea5ce929a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:05.200288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a1d62-f86c-4602-b205-f05ea5ce929a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:05.212274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:05.236082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:05.236745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:05.237026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:05.237298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:05.237888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:05.239237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:05.247994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:05.249218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:05.250054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 639/1290] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:14:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:14:05.255172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378d01-6215-4231-bcf8-a3d4f1bf6a01 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:05.354874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45378d01-6215-4231-bcf8-a3d4f1bf6a01 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:05.388663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce696d28-fccf-4e72-a665-25561efccd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:05.389289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696d28-fccf-4e72-a665-25561efccd3f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:05.389576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696d28-fccf-4e72-a665-25561efccd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:05.389854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce696d28-fccf-4e72-a665-25561efccd3f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:05.390485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce696d28-fccf-4e72-a665-25561efccd3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:05.390792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce696d28-fccf-4e72-a665-25561efccd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:05.392159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce696d28-fccf-4e72-a665-25561efccd3f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:05.396927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 652/1291] 10.222.0.86 () {56 vars in 1116 bytes} [Thu Aug 18 11:14:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:05.403507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:05.500997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58208a76-07b2-4197-b63f-6f249d4878ca None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:05.534371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748b6b6-4af9-488c-bd39-cb5cc170e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:05.534970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748b6b6-4af9-488c-bd39-cb5cc170e3bc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:05.535258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748b6b6-4af9-488c-bd39-cb5cc170e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:05.535536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748b6b6-4af9-488c-bd39-cb5cc170e3bc None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:05.536175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748b6b6-4af9-488c-bd39-cb5cc170e3bc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:05.536511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748b6b6-4af9-488c-bd39-cb5cc170e3bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:05.537881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748b6b6-4af9-488c-bd39-cb5cc170e3bc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:05.542493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 640/1292] 10.222.0.86 () {56 vars in 1116 bytes} [Thu Aug 18 11:14:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:07.429662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583183c4-69a4-4020-b9f1-b12e4455b01c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.430180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583183c4-69a4-4020-b9f1-b12e4455b01c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.430269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583183c4-69a4-4020-b9f1-b12e4455b01c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.431622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 653/1293] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:14:07.436899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290601-67e2-4b5b-9674-1589d15272fd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.437292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290601-67e2-4b5b-9674-1589d15272fd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.437448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290601-67e2-4b5b-9674-1589d15272fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.455872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-04290601-67e2-4b5b-9674-1589d15272fd None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:07.457267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-04290601-67e2-4b5b-9674-1589d15272fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:07.487165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:07.524292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 641/1294] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:14:07.800164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583183c4-69a4-4020-b9f1-b12e4455b01c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:07.832468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:07.902401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583183c4-69a4-4020-b9f1-b12e4455b01c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:07.935485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907cb20-381f-4d40-8398-77696d04832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:07.936077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907cb20-381f-4d40-8398-77696d04832d None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:07.936385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907cb20-381f-4d40-8398-77696d04832d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:07.936746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907cb20-381f-4d40-8398-77696d04832d None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:07.937295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907cb20-381f-4d40-8398-77696d04832d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:07.938657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907cb20-381f-4d40-8398-77696d04832d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:08.001666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 654/1295] 10.222.0.86 () {60 vars in 1141 bytes} [Thu Aug 18 11:14:07 2022] POST /identity/v3/services => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:14:09.923479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dcc1b-c479-4bcc-b649-60ce2488b9f5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:09.924034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dcc1b-c479-4bcc-b649-60ce2488b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:09.924034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dcc1b-c479-4bcc-b649-60ce2488b9f5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:09.925374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 642/1296] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:14:09.930546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6308e5-3740-46f2-8ff2-37593dff87c2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:09.930968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6308e5-3740-46f2-8ff2-37593dff87c2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:09.931111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6308e5-3740-46f2-8ff2-37593dff87c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:09.948785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fd6308e5-3740-46f2-8ff2-37593dff87c2 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:09.951582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fd6308e5-3740-46f2-8ff2-37593dff87c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:10.021743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 655/1297] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:14:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 11:14:10.295601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dcc1b-c479-4bcc-b649-60ce2488b9f5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:10.399773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dcc1b-c479-4bcc-b649-60ce2488b9f5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:10.433643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:10.434203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:10.434490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:10.434769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:10.435351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:10.436773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:10.445896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:10.452034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:10.452929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 643/1298] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:14:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:14:10.453730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6308e5-3740-46f2-8ff2-37593dff87c2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:10.472020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:10.550367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6308e5-3740-46f2-8ff2-37593dff87c2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:10.583552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:10.584416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:10.585909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:10.586182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:10.586841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:10.587146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:10.588528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:10.593592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 656/1299] 10.222.0.86 () {56 vars in 1116 bytes} [Thu Aug 18 11:14:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:14:10.599722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:10.630780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:10.699280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436def0-0966-41a8-ba04-e4004ec2829c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:10.732676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7039f7b-f073-4186-bd1d-6a0626a6c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:10.733217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7039f7b-f073-4186-bd1d-6a0626a6c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:10.733503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7039f7b-f073-4186-bd1d-6a0626a6c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:10.733788 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7039f7b-f073-4186-bd1d-6a0626a6c2c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:10.734495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7039f7b-f073-4186-bd1d-6a0626a6c2c6 None admin] RBAC: Adding query filter params (interface=public, service_id=375a1ad0f9b44587b5fe65933c95a87e, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:10.734809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7039f7b-f073-4186-bd1d-6a0626a6c2c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:10.736305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7039f7b-f073-4186-bd1d-6a0626a6c2c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:10.741976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 644/1300] 10.222.0.86 () {56 vars in 1251 bytes} [Thu Aug 18 11:14:10 2022] GET /identity/v3/endpoints?service_id=375a1ad0f9b44587b5fe65933c95a87e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:10.747797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:10.828071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:10.845506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629ae7-b892-4999-8b64-dfac2a5dcf65 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:10.878458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b445-4631-4466-bcfe-4c60845d424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:10.879114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b445-4631-4466-bcfe-4c60845d424d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:10.879399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b445-4631-4466-bcfe-4c60845d424d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:10.879672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b445-4631-4466-bcfe-4c60845d424d None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:10.880301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375b445-4631-4466-bcfe-4c60845d424d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:10.881712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375b445-4631-4466-bcfe-4c60845d424d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:10.888982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 657/1301] 10.222.0.86 () {56 vars in 1087 bytes} [Thu Aug 18 11:14:10 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:14:12.796847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39a7-3c66-416a-8130-18f6becac316 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:12.797400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39a7-3c66-416a-8130-18f6becac316 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:12.797534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39a7-3c66-416a-8130-18f6becac316 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:12.798826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 645/1302] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:14:12.805043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ba95-c364-44e1-9709-5aa4f75c2f05 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:12.805452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ba95-c364-44e1-9709-5aa4f75c2f05 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:12.805594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ba95-c364-44e1-9709-5aa4f75c2f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:12.823421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-eb82ba95-c364-44e1-9709-5aa4f75c2f05 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:14:12.824621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-eb82ba95-c364-44e1-9709-5aa4f75c2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:14:12.890109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 658/1303] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:14:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 11:14:13.159559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c39a7-3c66-416a-8130-18f6becac316 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:13.256635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:13.263885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c39a7-3c66-416a-8130-18f6becac316 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:13.297060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:13.297680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:13.297956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:13.298227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:13.298799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:13.300153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 11:14:13.311606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 11:14:13.312896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 18 11:14:13.314048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 646/1304] 10.222.0.86 () {56 vars in 1117 bytes} [Thu Aug 18 11:14:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 11:14:13.318990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82ba95-c364-44e1-9709-5aa4f75c2f05 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:13.401178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:13.423256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82ba95-c364-44e1-9709-5aa4f75c2f05 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:13.458236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88338486-012b-4e07-819e-13deb2da2909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:13.458939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88338486-012b-4e07-819e-13deb2da2909 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:13.459288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88338486-012b-4e07-819e-13deb2da2909 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:13.459569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88338486-012b-4e07-819e-13deb2da2909 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:13.460926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88338486-012b-4e07-819e-13deb2da2909 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:14:13.461231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88338486-012b-4e07-819e-13deb2da2909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:13.462636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88338486-012b-4e07-819e-13deb2da2909 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:13.467963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 659/1305] 10.222.0.86 () {56 vars in 1116 bytes} [Thu Aug 18 11:14:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:14:13.473751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:14:13.572552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8964-ff95-468a-872d-1f6ef07c8b65 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:14:13.605806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9867e-a517-4962-a98f-817888fff574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:14:13.606400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9867e-a517-4962-a98f-817888fff574 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:14:13.606682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9867e-a517-4962-a98f-817888fff574 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:14:13.606955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9867e-a517-4962-a98f-817888fff574 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:14:13.607613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9867e-a517-4962-a98f-817888fff574 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:14:13.609003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9867e-a517-4962-a98f-817888fff574 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:14:13.699437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 647/1306] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:14:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:14:23.492689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=30 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:14:23.694022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:07.425648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d435ed-b9cc-459b-a629-e88946853212 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:07.426981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d435ed-b9cc-459b-a629-e88946853212 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:07.427689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d435ed-b9cc-459b-a629-e88946853212 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:07.438929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afec2b-a9ae-46ec-9ee6-1935a890a22e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:07.440111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afec2b-a9ae-46ec-9ee6-1935a890a22e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:07.441026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afec2b-a9ae-46ec-9ee6-1935a890a22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:07.445040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 660/1307] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:07 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:07.572520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-22afec2b-a9ae-46ec-9ee6-1935a890a22e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:07.574776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-22afec2b-a9ae-46ec-9ee6-1935a890a22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:07.710975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 648/1308] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:08.021695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfa9b-2e06-4499-8821-3e304d30ae59 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:08.022142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfa9b-2e06-4499-8821-3e304d30ae59 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:08.022539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfa9b-2e06-4499-8821-3e304d30ae59 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:08.025046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 661/1309] 10.222.0.86 () {54 vars in 965 bytes} [Thu Aug 18 11:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:08.031414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887430fa-5380-4d8f-8f79-33acc83d30d9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:08.031732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887430fa-5380-4d8f-8f79-33acc83d30d9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:08.032014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887430fa-5380-4d8f-8f79-33acc83d30d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:08.115707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-887430fa-5380-4d8f-8f79-33acc83d30d9 None None] MFA Rules not processed for user `bfd4d0f2f95b4861888c33b0c66c602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:08.118004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-887430fa-5380-4d8f-8f79-33acc83d30d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:08.141149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:08.214218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cfa9b-2e06-4499-8821-3e304d30ae59 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:08.216433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 649/1310] 10.222.0.86 () {58 vars in 1062 bytes} [Thu Aug 18 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:08.216767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fe8cfa9b-2e06-4499-8821-3e304d30ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:08.357218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cfa9b-2e06-4499-8821-3e304d30ae59 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:08.444026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd7d8-3002-4398-b742-0e828a819add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:08.444718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd7d8-3002-4398-b742-0e828a819add service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:08.445007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd7d8-3002-4398-b742-0e828a819add service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:08.445187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd7d8-3002-4398-b742-0e828a819add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:08.447974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-95afd7d8-3002-4398-b742-0e828a819add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:08.506848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:08.564436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd7d8-3002-4398-b742-0e828a819add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:08.566055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd7d8-3002-4398-b742-0e828a819add service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:08.585851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 662/1311] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:10.864972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91f1f-0120-49d8-ae60-936c0a3a75db None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:10.865508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91f1f-0120-49d8-ae60-936c0a3a75db None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:10.865508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91f1f-0120-49d8-ae60-936c0a3a75db None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:10.867060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 650/1312] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:10.873275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d51f7-67e2-41a7-9d9d-61db57f40e67 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:10.873781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d51f7-67e2-41a7-9d9d-61db57f40e67 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:10.873858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d51f7-67e2-41a7-9d9d-61db57f40e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:10.969309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d70d51f7-67e2-41a7-9d9d-61db57f40e67 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:10.970604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d70d51f7-67e2-41a7-9d9d-61db57f40e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:11.204249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 663/1313] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:11.487198 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91f1f-0120-49d8-ae60-936c0a3a75db None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:11.488757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a3b91f1f-0120-49d8-ae60-936c0a3a75db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:11.594519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91f1f-0120-49d8-ae60-936c0a3a75db None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:11.666545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:11.669395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d53663-532b-4812-a771-6197100144f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:11.670011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53663-532b-4812-a771-6197100144f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:11.670299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53663-532b-4812-a771-6197100144f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:11.670574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53663-532b-4812-a771-6197100144f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:11.672233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a0d53663-532b-4812-a771-6197100144f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:11.779934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d53663-532b-4812-a771-6197100144f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:11.781325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d53663-532b-4812-a771-6197100144f3 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:11.799175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 651/1314] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:14.207672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9019b-75bc-402a-907a-6a66a8fb8caf None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:14.208045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9019b-75bc-402a-907a-6a66a8fb8caf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:14.208262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9019b-75bc-402a-907a-6a66a8fb8caf None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:14.209610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 664/1315] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:14.215550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145718c0-83a1-4b10-9a45-f6ba3e46b014 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:14.215952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145718c0-83a1-4b10-9a45-f6ba3e46b014 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:14.216100 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145718c0-83a1-4b10-9a45-f6ba3e46b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:14.281316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-145718c0-83a1-4b10-9a45-f6ba3e46b014 None None] MFA Rules not processed for user `38be8d9b873e4425bdf8771a0a456f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:14.282504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-145718c0-83a1-4b10-9a45-f6ba3e46b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:14.332421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:14.377024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 652/1316] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:14.663816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9019b-75bc-402a-907a-6a66a8fb8caf None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:14.666106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cab9019b-75bc-402a-907a-6a66a8fb8caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:14.675654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:14.766743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9019b-75bc-402a-907a-6a66a8fb8caf None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:14.839558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0af8-52bd-4614-981a-29ebc9bd2ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:14.840163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0af8-52bd-4614-981a-29ebc9bd2ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:14.840491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0af8-52bd-4614-981a-29ebc9bd2ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:14.840769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0af8-52bd-4614-981a-29ebc9bd2ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:14.842359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-926a0af8-52bd-4614-981a-29ebc9bd2ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:14.903311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:14.949821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a0af8-52bd-4614-981a-29ebc9bd2ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:14.951181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a0af8-52bd-4614-981a-29ebc9bd2ff6 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:14.969084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 665/1317] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:17.652879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8afed-e0b4-4b25-8975-a5705a4ff93a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:17.653433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8afed-e0b4-4b25-8975-a5705a4ff93a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:17.653695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8afed-e0b4-4b25-8975-a5705a4ff93a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:17.655049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 653/1318] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:17.660267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec7b99-aefc-45ed-819d-e6a0f09b9ac0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:17.660642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec7b99-aefc-45ed-819d-e6a0f09b9ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:17.660860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec7b99-aefc-45ed-819d-e6a0f09b9ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:17.725496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-20ec7b99-aefc-45ed-819d-e6a0f09b9ac0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:17.727364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-20ec7b99-aefc-45ed-819d-e6a0f09b9ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:17.821593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 666/1319] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:18.123180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fcdd3-d545-4a1d-ae66-110cc031c981 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:18.123459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fcdd3-d545-4a1d-ae66-110cc031c981 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:18.123734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fcdd3-d545-4a1d-ae66-110cc031c981 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:18.125156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 654/1320] 10.222.0.86 () {54 vars in 965 bytes} [Thu Aug 18 11:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:18.131016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e3df0-207a-421f-959b-12987544655f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:18.131300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e3df0-207a-421f-959b-12987544655f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:18.131572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e3df0-207a-421f-959b-12987544655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:18.155084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:18.208631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d94e3df0-207a-421f-959b-12987544655f None None] MFA Rules not processed for user `bfd4d0f2f95b4861888c33b0c66c602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:18.209838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d94e3df0-207a-421f-959b-12987544655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:18.285386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 667/1321] 10.222.0.86 () {58 vars in 1062 bytes} [Thu Aug 18 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:20:18.295303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fcdd3-d545-4a1d-ae66-110cc031c981 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:18.296892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-310fcdd3-d545-4a1d-ae66-110cc031c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:18.400379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fcdd3-d545-4a1d-ae66-110cc031c981 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:18.471952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e875e75-3b9f-476b-807b-ccd3f28e9542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:18.472589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875e75-3b9f-476b-807b-ccd3f28e9542 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:18.472867 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875e75-3b9f-476b-807b-ccd3f28e9542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:18.473136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e875e75-3b9f-476b-807b-ccd3f28e9542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:18.474701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3e875e75-3b9f-476b-807b-ccd3f28e9542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:18.482808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:18.582549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e875e75-3b9f-476b-807b-ccd3f28e9542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:18.583984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e875e75-3b9f-476b-807b-ccd3f28e9542 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:18.602986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 655/1322] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:21.949273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7dd4-7ef0-4aa6-b097-175b8c8c85df None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:21.949852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7dd4-7ef0-4aa6-b097-175b8c8c85df None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:21.949852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e7dd4-7ef0-4aa6-b097-175b8c8c85df None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:21.951168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 668/1323] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:21.956423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cac6b-cf39-422b-a4b4-01ffcd4f8873 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:21.956842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cac6b-cf39-422b-a4b4-01ffcd4f8873 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:21.956986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cac6b-cf39-422b-a4b4-01ffcd4f8873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:22.023595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ad3cac6b-cf39-422b-a4b4-01ffcd4f8873 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:22.025204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ad3cac6b-cf39-422b-a4b4-01ffcd4f8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:22.082582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:22.123289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 656/1324] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:22.412125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e7dd4-7ef0-4aa6-b097-175b8c8c85df None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:22.414066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-065e7dd4-7ef0-4aa6-b097-175b8c8c85df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:22.519304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e7dd4-7ef0-4aa6-b097-175b8c8c85df None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:22.532377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:22.594066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f05765-4f30-49a3-8351-9c0e4e65d18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:22.594676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f05765-4f30-49a3-8351-9c0e4e65d18e service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:22.594954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f05765-4f30-49a3-8351-9c0e4e65d18e service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:22.595224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f05765-4f30-49a3-8351-9c0e4e65d18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:22.596859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-63f05765-4f30-49a3-8351-9c0e4e65d18e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:22.707210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f05765-4f30-49a3-8351-9c0e4e65d18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:22.708598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f05765-4f30-49a3-8351-9c0e4e65d18e service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:22.729420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 669/1325] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:24.706884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141eb70-365f-4426-adff-a727aa347b83 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:24.707471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141eb70-365f-4426-adff-a727aa347b83 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:24.707471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141eb70-365f-4426-adff-a727aa347b83 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:24.708821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 657/1326] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:24.714177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb1fb-2406-473f-9d05-cb2d308199c5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:24.714605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb1fb-2406-473f-9d05-cb2d308199c5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:24.714711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb1fb-2406-473f-9d05-cb2d308199c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:24.764431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:24.783051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-635eb1fb-2406-473f-9d05-cb2d308199c5 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:24.787809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-635eb1fb-2406-473f-9d05-cb2d308199c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:24.880811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 670/1327] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:25.169110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141eb70-365f-4426-adff-a727aa347b83 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:25.170694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d141eb70-365f-4426-adff-a727aa347b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:25.280723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141eb70-365f-4426-adff-a727aa347b83 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:25.363393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3b36-bcb6-46cb-b607-ee11810177ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:25.364024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3b36-bcb6-46cb-b607-ee11810177ed service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:25.364350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3b36-bcb6-46cb-b607-ee11810177ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:25.364630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3b36-bcb6-46cb-b607-ee11810177ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:25.366545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e4ed3b36-bcb6-46cb-b607-ee11810177ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:25.385968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:25.482484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3b36-bcb6-46cb-b607-ee11810177ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:25.483922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3b36-bcb6-46cb-b607-ee11810177ed service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:25.502894 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 658/1328] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:27.480002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93016e3-b506-44b9-9838-2815c6ba160b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:27.480586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93016e3-b506-44b9-9838-2815c6ba160b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:27.480586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93016e3-b506-44b9-9838-2815c6ba160b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:27.482140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 671/1329] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:27.487175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d5686-2863-4283-8470-836ec1ede621 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:27.487630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d5686-2863-4283-8470-836ec1ede621 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:27.487725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d5686-2863-4283-8470-836ec1ede621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:27.556146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d74d5686-2863-4283-8470-836ec1ede621 None None] MFA Rules not processed for user `38be8d9b873e4425bdf8771a0a456f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:27.557395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d74d5686-2863-4283-8470-836ec1ede621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:27.626430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:27.659020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 659/1330] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:27.936668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93016e3-b506-44b9-9838-2815c6ba160b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:27.938346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c93016e3-b506-44b9-9838-2815c6ba160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:28.065545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93016e3-b506-44b9-9838-2815c6ba160b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:28.087664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:28.141334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972b4bf-51be-4d42-839e-91eb4aed177b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:28.141933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b4bf-51be-4d42-839e-91eb4aed177b service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:28.142210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b4bf-51be-4d42-839e-91eb4aed177b service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:28.142478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b4bf-51be-4d42-839e-91eb4aed177b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:28.144044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5972b4bf-51be-4d42-839e-91eb4aed177b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:28.256279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b4bf-51be-4d42-839e-91eb4aed177b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:28.258049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b4bf-51be-4d42-839e-91eb4aed177b service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:28.276139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 672/1331] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:30.619553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adedb-23c5-4646-b3a2-b5d885096886 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:30.620039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adedb-23c5-4646-b3a2-b5d885096886 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:30.620134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adedb-23c5-4646-b3a2-b5d885096886 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:30.621506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 660/1332] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:30.626934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0baf8e-c1ae-4d96-bce5-daffc9e44472 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:30.627352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0baf8e-c1ae-4d96-bce5-daffc9e44472 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:30.627495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0baf8e-c1ae-4d96-bce5-daffc9e44472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:30.690706 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:30.693555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-be0baf8e-c1ae-4d96-bce5-daffc9e44472 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:30.694893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-be0baf8e-c1ae-4d96-bce5-daffc9e44472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:30.790441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 673/1333] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:20:31.070824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adedb-23c5-4646-b3a2-b5d885096886 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:31.072454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6b6adedb-23c5-4646-b3a2-b5d885096886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:31.175944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adedb-23c5-4646-b3a2-b5d885096886 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:31.250253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134bcc1-71cb-4d86-8518-55889659a67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:31.250871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134bcc1-71cb-4d86-8518-55889659a67d service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:31.251149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134bcc1-71cb-4d86-8518-55889659a67d service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:31.251419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134bcc1-71cb-4d86-8518-55889659a67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:31.253062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3134bcc1-71cb-4d86-8518-55889659a67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:31.280762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:31.365890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134bcc1-71cb-4d86-8518-55889659a67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:31.368599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134bcc1-71cb-4d86-8518-55889659a67d service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:31.387298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 661/1334] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:33.336529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5f58-9920-40c0-bbe3-ef7f9ca837c9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:33.337049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5f58-9920-40c0-bbe3-ef7f9ca837c9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:33.337163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5f58-9920-40c0-bbe3-ef7f9ca837c9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:33.338416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 674/1335] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:33.343616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c928a-5f39-42e0-ad64-55c1f15fe542 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:33.344003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c928a-5f39-42e0-ad64-55c1f15fe542 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:33.344163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c928a-5f39-42e0-ad64-55c1f15fe542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:33.410602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3e9c928a-5f39-42e0-ad64-55c1f15fe542 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:33.411790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3e9c928a-5f39-42e0-ad64-55c1f15fe542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:33.484932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:33.507837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 662/1336] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:33.794287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d5f58-9920-40c0-bbe3-ef7f9ca837c9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:33.795793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7e8d5f58-9920-40c0-bbe3-ef7f9ca837c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:33.897673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d5f58-9920-40c0-bbe3-ef7f9ca837c9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:33.926279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:33.971314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4a3f-e4f6-4bd5-a61a-b4e8bcb9d906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:33.971915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4a3f-e4f6-4bd5-a61a-b4e8bcb9d906 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:33.972195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4a3f-e4f6-4bd5-a61a-b4e8bcb9d906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:33.972493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4a3f-e4f6-4bd5-a61a-b4e8bcb9d906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:33.974056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e59e4a3f-e4f6-4bd5-a61a-b4e8bcb9d906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:34.081472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e4a3f-e4f6-4bd5-a61a-b4e8bcb9d906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:34.082828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e4a3f-e4f6-4bd5-a61a-b4e8bcb9d906 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:34.101684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 675/1337] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:36.639455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977beb5-ff64-4cb0-b9b0-47573ecb8758 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:36.640019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977beb5-ff64-4cb0-b9b0-47573ecb8758 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:36.640112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977beb5-ff64-4cb0-b9b0-47573ecb8758 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:36.641478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 663/1338] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:36.649618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c297e6-3f82-44bc-bef9-ee10bfb5db75 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:36.649618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c297e6-3f82-44bc-bef9-ee10bfb5db75 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:36.649618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c297e6-3f82-44bc-bef9-ee10bfb5db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:36.715938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-79c297e6-3f82-44bc-bef9-ee10bfb5db75 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:36.717207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-79c297e6-3f82-44bc-bef9-ee10bfb5db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:36.725681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:36.813558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 676/1339] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:37.100276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977beb5-ff64-4cb0-b9b0-47573ecb8758 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:37.102436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0977beb5-ff64-4cb0-b9b0-47573ecb8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:37.203714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977beb5-ff64-4cb0-b9b0-47573ecb8758 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:37.278053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7349b-e35a-4a41-94ff-10a108d02f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:37.278656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7349b-e35a-4a41-94ff-10a108d02f3c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:37.278936 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7349b-e35a-4a41-94ff-10a108d02f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:37.279210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7349b-e35a-4a41-94ff-10a108d02f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:37.280814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ed7349b-e35a-4a41-94ff-10a108d02f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:37.315563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:37.389186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7349b-e35a-4a41-94ff-10a108d02f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:37.390536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7349b-e35a-4a41-94ff-10a108d02f3c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:37.410435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 664/1340] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:41.540602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c6360-8837-4a9a-89c2-e1b3a2ccdd0a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:41.541124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c6360-8837-4a9a-89c2-e1b3a2ccdd0a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:41.541219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c6360-8837-4a9a-89c2-e1b3a2ccdd0a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:41.542481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 677/1341] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:41.548181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16d875-a7a0-4719-8da6-8544c5d03d4a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:41.548578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16d875-a7a0-4719-8da6-8544c5d03d4a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:41.548657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16d875-a7a0-4719-8da6-8544c5d03d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:41.615970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9b16d875-a7a0-4719-8da6-8544c5d03d4a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:41.617734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9b16d875-a7a0-4719-8da6-8544c5d03d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:41.706533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:41.718258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 665/1342] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:42.005368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c6360-8837-4a9a-89c2-e1b3a2ccdd0a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:42.007674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dc6c6360-8837-4a9a-89c2-e1b3a2ccdd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:42.111836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c6360-8837-4a9a-89c2-e1b3a2ccdd0a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:42.150371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:42.186525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae0f74-b469-4de3-a8e4-c0c1665b771d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:42.187137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0f74-b469-4de3-a8e4-c0c1665b771d service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:42.187430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0f74-b469-4de3-a8e4-c0c1665b771d service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:42.187708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0f74-b469-4de3-a8e4-c0c1665b771d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:42.189343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-51ae0f74-b469-4de3-a8e4-c0c1665b771d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:42.302244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0f74-b469-4de3-a8e4-c0c1665b771d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:42.304351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0f74-b469-4de3-a8e4-c0c1665b771d service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:42.322796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 678/1343] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:45.195659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b878-b810-4874-b561-f804146dacc6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:45.196228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b878-b810-4874-b561-f804146dacc6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:45.196228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3b878-b810-4874-b561-f804146dacc6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:45.197537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 666/1344] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:45.203077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659594b-058f-4ac3-9964-aed777bd7f6b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:45.203885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659594b-058f-4ac3-9964-aed777bd7f6b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:45.204161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659594b-058f-4ac3-9964-aed777bd7f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:45.274167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9659594b-058f-4ac3-9964-aed777bd7f6b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:45.275401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9659594b-058f-4ac3-9964-aed777bd7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:45.293522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:45.374308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 679/1345] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:45.659420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b878-b810-4874-b561-f804146dacc6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:45.660969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3ad3b878-b810-4874-b561-f804146dacc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:45.765547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3b878-b810-4874-b561-f804146dacc6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:45.842116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dd9cc-5315-4625-b601-766c3a7cd0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:45.842733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd9cc-5315-4625-b601-766c3a7cd0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:45.843015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd9cc-5315-4625-b601-766c3a7cd0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:45.843291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd9cc-5315-4625-b601-766c3a7cd0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:45.844964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fd6dd9cc-5315-4625-b601-766c3a7cd0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:45.889343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:45.959154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dd9cc-5315-4625-b601-766c3a7cd0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:45.960760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dd9cc-5315-4625-b601-766c3a7cd0d1 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:45.979930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 667/1346] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:50.395798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e169893-717a-433c-a81b-408a7a862d48 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:50.396341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e169893-717a-433c-a81b-408a7a862d48 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:50.396462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e169893-717a-433c-a81b-408a7a862d48 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:50.398031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 680/1347] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:50.403554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba31b8-be3c-47f9-89ff-b0d31bb0e116 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:50.403992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba31b8-be3c-47f9-89ff-b0d31bb0e116 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:50.404170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba31b8-be3c-47f9-89ff-b0d31bb0e116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:50.476099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4cba31b8-be3c-47f9-89ff-b0d31bb0e116 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:50.477382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4cba31b8-be3c-47f9-89ff-b0d31bb0e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:50.576177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:50.578731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 668/1348] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:20:50.860998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e169893-717a-433c-a81b-408a7a862d48 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:20:50.862511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5e169893-717a-433c-a81b-408a7a862d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:50.963664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e169893-717a-433c-a81b-408a7a862d48 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:20:51.012110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:51.038755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b55b1-f2c0-4dce-8dda-0289d86750db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:20:51.039356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b55b1-f2c0-4dce-8dda-0289d86750db service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:51.039635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b55b1-f2c0-4dce-8dda-0289d86750db service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:51.039907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b55b1-f2c0-4dce-8dda-0289d86750db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:51.041501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-742b55b1-f2c0-4dce-8dda-0289d86750db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:51.149506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b55b1-f2c0-4dce-8dda-0289d86750db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:20:51.150927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b55b1-f2c0-4dce-8dda-0289d86750db service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:20:51.169870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 681/1349] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:20:56.099873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acc2e-1c8d-4b16-939b-1ba6da147c2b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:56.101093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acc2e-1c8d-4b16-939b-1ba6da147c2b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:56.101093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acc2e-1c8d-4b16-939b-1ba6da147c2b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:56.103002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 669/1350] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:20:56.108083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95a51-6d92-4246-bb1d-f0ee0bd213ec None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:20:56.108577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95a51-6d92-4246-bb1d-f0ee0bd213ec None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:20:56.108668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95a51-6d92-4246-bb1d-f0ee0bd213ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:20:56.232677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4fb95a51-6d92-4246-bb1d-f0ee0bd213ec None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:20:56.234113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4fb95a51-6d92-4246-bb1d-f0ee0bd213ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:20:56.259082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:20:56.415753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 682/1351] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:20:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:00.740861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89865-a310-4000-bd55-a004df42c167 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:00.741437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89865-a310-4000-bd55-a004df42c167 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:00.741437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89865-a310-4000-bd55-a004df42c167 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:00.742923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 670/1352] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:00.747902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb4697-8af8-4ee2-926f-4fed885eeae6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:00.748724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb4697-8af8-4ee2-926f-4fed885eeae6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:00.749258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb4697-8af8-4ee2-926f-4fed885eeae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:00.834325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-21eb4697-8af8-4ee2-926f-4fed885eeae6 None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:00.835647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-21eb4697-8af8-4ee2-926f-4fed885eeae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:00.911400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:00.947995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 683/1353] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:21:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:02.349158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f54f-f1ee-49fd-81d6-52e978989b55 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:02.349748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f54f-f1ee-49fd-81d6-52e978989b55 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:02.350106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f54f-f1ee-49fd-81d6-52e978989b55 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:02.352797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 671/1354] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:21:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:02.358053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7ae59-d2e1-4aac-9977-2c4dcc30aa43 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:02.358505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7ae59-d2e1-4aac-9977-2c4dcc30aa43 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:02.358648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7ae59-d2e1-4aac-9977-2c4dcc30aa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:02.438643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-69f7ae59-d2e1-4aac-9977-2c4dcc30aa43 None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:02.439833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-69f7ae59-d2e1-4aac-9977-2c4dcc30aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:02.554843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 684/1355] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:21:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:06.018025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f473e3-497b-4c7f-90c2-7e2dc71b4a1a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:06.019561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f473e3-497b-4c7f-90c2-7e2dc71b4a1a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:06.019561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f473e3-497b-4c7f-90c2-7e2dc71b4a1a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:06.022777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 672/1356] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:06.027762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d0c9-6fc8-42d2-8964-4111b0ed7dcc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:06.028358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d0c9-6fc8-42d2-8964-4111b0ed7dcc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:06.028358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d0c9-6fc8-42d2-8964-4111b0ed7dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:06.078562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:06.120418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9522d0c9-6fc8-42d2-8964-4111b0ed7dcc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:06.121847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9522d0c9-6fc8-42d2-8964-4111b0ed7dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:06.263145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 685/1357] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:06.577033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d7a2a-00c8-4f13-aaf2-eb5bbb9ad2fc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:06.577607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d7a2a-00c8-4f13-aaf2-eb5bbb9ad2fc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:06.580317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d7a2a-00c8-4f13-aaf2-eb5bbb9ad2fc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:06.580317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 673/1358] 10.222.0.86 () {54 vars in 962 bytes} [Thu Aug 18 11:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:06.587238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f76f-5514-4f92-898e-64a048145c3c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:06.587995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f76f-5514-4f92-898e-64a048145c3c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:06.588717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f76f-5514-4f92-898e-64a048145c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:06.694533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9265f76f-5514-4f92-898e-64a048145c3c None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:06.696080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9265f76f-5514-4f92-898e-64a048145c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:06.751573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:06.822723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 686/1359] 10.222.0.86 () {58 vars in 1059 bytes} [Thu Aug 18 11:21:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:06.830504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d7a2a-00c8-4f13-aaf2-eb5bbb9ad2fc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:06.832000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d5d7a2a-00c8-4f13-aaf2-eb5bbb9ad2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:06.988081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d7a2a-00c8-4f13-aaf2-eb5bbb9ad2fc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:07.067876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:07.109754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e63ee3-3b85-42b7-a4df-6fe884e78d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:07.110433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63ee3-3b85-42b7-a4df-6fe884e78d1b service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:07.110819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63ee3-3b85-42b7-a4df-6fe884e78d1b service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:07.111199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63ee3-3b85-42b7-a4df-6fe884e78d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:07.112948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-36e63ee3-3b85-42b7-a4df-6fe884e78d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:07.219402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e63ee3-3b85-42b7-a4df-6fe884e78d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:07.224377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e63ee3-3b85-42b7-a4df-6fe884e78d1b service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:07.243867 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 674/1360] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:09.414255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62239a-b4c6-4a16-8ae9-d9457d65c709 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:09.414808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62239a-b4c6-4a16-8ae9-d9457d65c709 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:09.414808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62239a-b4c6-4a16-8ae9-d9457d65c709 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:09.419892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 687/1361] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:21:09.421654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365d85-3376-4511-a210-2763249f0d9a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:09.422412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365d85-3376-4511-a210-2763249f0d9a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:09.422843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00365d85-3376-4511-a210-2763249f0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:09.496053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-00365d85-3376-4511-a210-2763249f0d9a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:09.497700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-00365d85-3376-4511-a210-2763249f0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:09.542805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:09.616607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 675/1362] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:09.913357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62239a-b4c6-4a16-8ae9-d9457d65c709 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:09.914958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6c62239a-b4c6-4a16-8ae9-d9457d65c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:10.075314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62239a-b4c6-4a16-8ae9-d9457d65c709 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:10.086102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:10.204625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78be046-8731-4b8f-923f-42b77a22ede5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:10.204625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be046-8731-4b8f-923f-42b77a22ede5 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:10.204625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be046-8731-4b8f-923f-42b77a22ede5 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:10.204625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be046-8731-4b8f-923f-42b77a22ede5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:10.205057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d78be046-8731-4b8f-923f-42b77a22ede5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:10.316666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78be046-8731-4b8f-923f-42b77a22ede5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:10.319355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78be046-8731-4b8f-923f-42b77a22ede5 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:10.341881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 688/1363] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:12.866988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e88cd-188a-494d-827b-486624b927f4 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:12.867541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e88cd-188a-494d-827b-486624b927f4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:12.867541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e88cd-188a-494d-827b-486624b927f4 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:12.869149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 676/1364] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:12.876175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc858-16d4-4982-81a4-23f897b54de0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:12.876693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc858-16d4-4982-81a4-23f897b54de0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:12.876775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc858-16d4-4982-81a4-23f897b54de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:12.896624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:12.956289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8e4fc858-16d4-4982-81a4-23f897b54de0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:12.957498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8e4fc858-16d4-4982-81a4-23f897b54de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:13.087380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 689/1365] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:13.387817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db0708-ee88-446c-bffc-fc460e17517b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:13.388107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db0708-ee88-446c-bffc-fc460e17517b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:13.388425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db0708-ee88-446c-bffc-fc460e17517b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:13.389785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 677/1366] 10.222.0.86 () {54 vars in 962 bytes} [Thu Aug 18 11:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:13.394993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088874d-043b-4b65-a3a9-da1c54c5640b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:13.395280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088874d-043b-4b65-a3a9-da1c54c5640b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:13.395553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088874d-043b-4b65-a3a9-da1c54c5640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:13.479719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9088874d-043b-4b65-a3a9-da1c54c5640b None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:13.480987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9088874d-043b-4b65-a3a9-da1c54c5640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:13.518532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:13.608262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 690/1367] 10.222.0.86 () {58 vars in 1059 bytes} [Thu Aug 18 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:13.616600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db0708-ee88-446c-bffc-fc460e17517b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:13.618165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-04db0708-ee88-446c-bffc-fc460e17517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:13.871165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db0708-ee88-446c-bffc-fc460e17517b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:13.901255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:14.020887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab77eeb-c0b6-4259-8a1e-df43a8ea118f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:14.022615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77eeb-c0b6-4259-8a1e-df43a8ea118f service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:14.023130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77eeb-c0b6-4259-8a1e-df43a8ea118f service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:14.023632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77eeb-c0b6-4259-8a1e-df43a8ea118f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:14.027309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9ab77eeb-c0b6-4259-8a1e-df43a8ea118f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:14.176137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab77eeb-c0b6-4259-8a1e-df43a8ea118f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:14.179622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab77eeb-c0b6-4259-8a1e-df43a8ea118f service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:14.212561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 678/1368] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:14.734345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad077-9490-40af-9c25-335021351f06 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:14.734848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad077-9490-40af-9c25-335021351f06 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:14.734848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad077-9490-40af-9c25-335021351f06 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:14.736384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 691/1369] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:14.741774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55050a51-284e-4f30-8b62-2378be71cd28 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:14.742065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55050a51-284e-4f30-8b62-2378be71cd28 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:14.742343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55050a51-284e-4f30-8b62-2378be71cd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:14.776174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:14.813962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-55050a51-284e-4f30-8b62-2378be71cd28 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:14.815176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55050a51-284e-4f30-8b62-2378be71cd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:14.920895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 679/1370] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:15.514938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5bd0-2d99-4e90-946b-534f67b02ed6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:15.515229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5bd0-2d99-4e90-946b-534f67b02ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:15.515507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5bd0-2d99-4e90-946b-534f67b02ed6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:15.517350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 692/1371] 10.222.0.86 () {54 vars in 964 bytes} [Thu Aug 18 11:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:15.522183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267767ef-d9b1-4260-97d9-96a1baca68fe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:15.522470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267767ef-d9b1-4260-97d9-96a1baca68fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:15.522749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267767ef-d9b1-4260-97d9-96a1baca68fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:15.609939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-267767ef-d9b1-4260-97d9-96a1baca68fe None None] MFA Rules not processed for user `0bc29638c1994ab09ea1b1f7c7f247ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:15.611150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-267767ef-d9b1-4260-97d9-96a1baca68fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:15.660827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:15.692364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 680/1372] 10.222.0.86 () {58 vars in 1061 bytes} [Thu Aug 18 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:15.700860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef5bd0-2d99-4e90-946b-534f67b02ed6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:15.702401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-70ef5bd0-2d99-4e90-946b-534f67b02ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:15.816066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef5bd0-2d99-4e90-946b-534f67b02ed6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:15.861131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:15.899507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee1389-3208-4711-a436-16a1b3ffc1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:15.900146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1389-3208-4711-a436-16a1b3ffc1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:15.900717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1389-3208-4711-a436-16a1b3ffc1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:15.901000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1389-3208-4711-a436-16a1b3ffc1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:15.902681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-56ee1389-3208-4711-a436-16a1b3ffc1a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:16.029556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee1389-3208-4711-a436-16a1b3ffc1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:16.031111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee1389-3208-4711-a436-16a1b3ffc1a9 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:16.054382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 693/1373] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:16.463600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6545b8-a31d-4625-b312-c662bd480aee None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:16.464114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6545b8-a31d-4625-b312-c662bd480aee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:16.464576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6545b8-a31d-4625-b312-c662bd480aee None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:16.467083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 681/1374] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:16.472379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff91ee9-8ee3-4d93-96be-a3f1e6d264d8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:16.472675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff91ee9-8ee3-4d93-96be-a3f1e6d264d8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:16.472956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff91ee9-8ee3-4d93-96be-a3f1e6d264d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:16.544136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8ff91ee9-8ee3-4d93-96be-a3f1e6d264d8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:16.545423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ff91ee9-8ee3-4d93-96be-a3f1e6d264d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:16.567795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:16.683382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 694/1375] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:16.994972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6545b8-a31d-4625-b312-c662bd480aee None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:16.996479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-db6545b8-a31d-4625-b312-c662bd480aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:17.228846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6545b8-a31d-4625-b312-c662bd480aee None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:17.283215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:17.376001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522d9e8-18ff-462e-9a73-eb150f6da08d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:17.376655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522d9e8-18ff-462e-9a73-eb150f6da08d service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:17.376939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522d9e8-18ff-462e-9a73-eb150f6da08d service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:17.377218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522d9e8-18ff-462e-9a73-eb150f6da08d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:17.378840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e522d9e8-18ff-462e-9a73-eb150f6da08d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:17.472661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522d9e8-18ff-462e-9a73-eb150f6da08d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:17.475009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522d9e8-18ff-462e-9a73-eb150f6da08d service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:17.495076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 682/1376] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:19.858109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ed85-6e0b-4cb7-910f-e7fea6fd68d3 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:19.858707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ed85-6e0b-4cb7-910f-e7fea6fd68d3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:19.858707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ed85-6e0b-4cb7-910f-e7fea6fd68d3 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:19.859924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 695/1377] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:19.868594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5718ff-bf1e-4fc5-82f5-9d041df62b31 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:19.870161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5718ff-bf1e-4fc5-82f5-9d041df62b31 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:19.870161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5718ff-bf1e-4fc5-82f5-9d041df62b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:19.947031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7c5718ff-bf1e-4fc5-82f5-9d041df62b31 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:19.948452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7c5718ff-bf1e-4fc5-82f5-9d041df62b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:19.955945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:20.064245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 683/1378] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:20.462675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ed85-6e0b-4cb7-910f-e7fea6fd68d3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:20.464184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2769ed85-6e0b-4cb7-910f-e7fea6fd68d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:20.623663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ed85-6e0b-4cb7-910f-e7fea6fd68d3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:20.628438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:20.773758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8e636-9b7e-42b0-86a3-18f280ce9467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:20.774318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e636-9b7e-42b0-86a3-18f280ce9467 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:20.774599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e636-9b7e-42b0-86a3-18f280ce9467 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:20.774994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e636-9b7e-42b0-86a3-18f280ce9467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:20.776970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-03a8e636-9b7e-42b0-86a3-18f280ce9467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:20.894230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8e636-9b7e-42b0-86a3-18f280ce9467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:20.896939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8e636-9b7e-42b0-86a3-18f280ce9467 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:20.919498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 696/1379] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:21:23.286933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b91d-7298-45c7-93ee-d2e0b595ca0e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:23.287563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b91d-7298-45c7-93ee-d2e0b595ca0e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:23.287563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b91d-7298-45c7-93ee-d2e0b595ca0e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:23.288877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 684/1380] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:23.294065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ab3d-5890-4a1d-9b7b-f3b2cc603d7e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:23.294455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ab3d-5890-4a1d-9b7b-f3b2cc603d7e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:23.294620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ab3d-5890-4a1d-9b7b-f3b2cc603d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:23.306314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:23.366280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7406ab3d-5890-4a1d-9b7b-f3b2cc603d7e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:23.367503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7406ab3d-5890-4a1d-9b7b-f3b2cc603d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:23.474286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 697/1381] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:23.810167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b91d-7298-45c7-93ee-d2e0b595ca0e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:23.811736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4816b91d-7298-45c7-93ee-d2e0b595ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:23.983081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:23.988669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b91d-7298-45c7-93ee-d2e0b595ca0e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:24.112735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff18d6-ae1a-4914-82c4-d4459c890e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:24.113272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff18d6-ae1a-4914-82c4-d4459c890e59 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:24.113555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff18d6-ae1a-4914-82c4-d4459c890e59 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:24.113831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff18d6-ae1a-4914-82c4-d4459c890e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:24.115575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-00ff18d6-ae1a-4914-82c4-d4459c890e59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:24.216875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff18d6-ae1a-4914-82c4-d4459c890e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:24.218516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff18d6-ae1a-4914-82c4-d4459c890e59 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:24.233479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:24.243019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 685/1382] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:26.769147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826faa-9795-46c5-9483-7b544cf2479d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:26.769740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826faa-9795-46c5-9483-7b544cf2479d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:26.769740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826faa-9795-46c5-9483-7b544cf2479d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:26.771573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 698/1383] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:26.777245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391852b6-379c-441c-a96d-9274f117329c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:26.777712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391852b6-379c-441c-a96d-9274f117329c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:26.777950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391852b6-379c-441c-a96d-9274f117329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:26.860972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-391852b6-379c-441c-a96d-9274f117329c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:26.862201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-391852b6-379c-441c-a96d-9274f117329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:26.980614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 686/1384] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:27.395170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826faa-9795-46c5-9483-7b544cf2479d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:27.398540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-52826faa-9795-46c5-9483-7b544cf2479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:27.560870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:27.657000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826faa-9795-46c5-9483-7b544cf2479d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:27.788984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cf2e9-aad7-4c4f-8d13-3a288344ba12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:27.789956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cf2e9-aad7-4c4f-8d13-3a288344ba12 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:27.790438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cf2e9-aad7-4c4f-8d13-3a288344ba12 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:27.790853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cf2e9-aad7-4c4f-8d13-3a288344ba12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:27.793468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c60cf2e9-aad7-4c4f-8d13-3a288344ba12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:27.870165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:27.921885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cf2e9-aad7-4c4f-8d13-3a288344ba12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:27.923799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cf2e9-aad7-4c4f-8d13-3a288344ba12 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:27.943716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 699/1385] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:30.065636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db45ce5-481f-4ec4-a800-93042d2fec5e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:30.066244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db45ce5-481f-4ec4-a800-93042d2fec5e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:30.066618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db45ce5-481f-4ec4-a800-93042d2fec5e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:30.070457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 687/1386] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:30.076072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681471-e6d7-46ee-93e9-505788ec998a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:30.076580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681471-e6d7-46ee-93e9-505788ec998a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:30.076688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681471-e6d7-46ee-93e9-505788ec998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:30.149033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cf681471-e6d7-46ee-93e9-505788ec998a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:30.150505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf681471-e6d7-46ee-93e9-505788ec998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:30.257134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 700/1387] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:30.558893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db45ce5-481f-4ec4-a800-93042d2fec5e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:30.560535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7db45ce5-481f-4ec4-a800-93042d2fec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:30.641688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:30.721229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db45ce5-481f-4ec4-a800-93042d2fec5e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:30.841029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da563b-2f22-4320-b7b7-50225590a767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:30.841562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da563b-2f22-4320-b7b7-50225590a767 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:30.841847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da563b-2f22-4320-b7b7-50225590a767 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:30.842119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da563b-2f22-4320-b7b7-50225590a767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:30.843712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-17da563b-2f22-4320-b7b7-50225590a767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:30.885600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:30.939621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da563b-2f22-4320-b7b7-50225590a767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:30.941271 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da563b-2f22-4320-b7b7-50225590a767 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:30.961169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 688/1388] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:32.441042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a552df-c56e-49ad-ac76-e31379fbbed1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:32.441712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a552df-c56e-49ad-ac76-e31379fbbed1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:32.441712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a552df-c56e-49ad-ac76-e31379fbbed1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:32.443528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 701/1389] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:32.449996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5ad5-a4a8-45f2-bd20-887cc4048a23 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:32.450522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5ad5-a4a8-45f2-bd20-887cc4048a23 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:32.450920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5ad5-a4a8-45f2-bd20-887cc4048a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:32.527182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8a5e5ad5-a4a8-45f2-bd20-887cc4048a23 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:32.528458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8a5e5ad5-a4a8-45f2-bd20-887cc4048a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:32.637138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 689/1390] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:32.943967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d2138-231e-4f13-985f-05e0251a28d8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:32.944283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d2138-231e-4f13-985f-05e0251a28d8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:32.944569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d2138-231e-4f13-985f-05e0251a28d8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:32.945895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 702/1391] 10.222.0.86 () {54 vars in 967 bytes} [Thu Aug 18 11:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:32.950999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1cc5-1d16-4d13-8c69-d7ab2c1a4417 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:32.951289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1cc5-1d16-4d13-8c69-d7ab2c1a4417 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:32.951567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1cc5-1d16-4d13-8c69-d7ab2c1a4417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:32.968031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:33.031312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-324c1cc5-1d16-4d13-8c69-d7ab2c1a4417 None None] MFA Rules not processed for user `514818f5b23c4234b259e5b47e698a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:33.032555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-324c1cc5-1d16-4d13-8c69-d7ab2c1a4417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:33.109692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 690/1392] 10.222.0.86 () {58 vars in 1064 bytes} [Thu Aug 18 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:33.117801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d2138-231e-4f13-985f-05e0251a28d8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:33.119296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-440d2138-231e-4f13-985f-05e0251a28d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:33.144203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c88856-229d-41e9-9285-3c6ad867ee0c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:33.144608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c88856-229d-41e9-9285-3c6ad867ee0c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:33.144909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c88856-229d-41e9-9285-3c6ad867ee0c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:33.147007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 691/1393] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:21:33.152601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:33.152890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:33.153166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:33.153878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:33.221523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:33.222727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:33.227261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d2138-231e-4f13-985f-05e0251a28d8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:33.280447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:33.303034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa9b36-fbe1-4bdd-b00e-c84f5daca366 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514818f5b23c4234b259e5b47e698a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:33.303750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9b36-fbe1-4bdd-b00e-c84f5daca366 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:33.304036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9b36-fbe1-4bdd-b00e-c84f5daca366 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:33.304337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9b36-fbe1-4bdd-b00e-c84f5daca366 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:33.306949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b3fa9b36-fbe1-4bdd-b00e-c84f5daca366 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:33.325976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 692/1394] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:33.384527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:33.418088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa9b36-fbe1-4bdd-b00e-c84f5daca366 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:33.419525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa9b36-fbe1-4bdd-b00e-c84f5daca366 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:33.437897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 703/1395] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:33.619750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:33.621011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:33.753759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51640-7b4b-4a04-9242-4f9b68d6abbe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:33.822658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:33.875572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e582a80-482b-4a17-a11c-df8deb5a2005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:33.876250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582a80-482b-4a17-a11c-df8deb5a2005 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:33.876534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582a80-482b-4a17-a11c-df8deb5a2005 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:33.876804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e582a80-482b-4a17-a11c-df8deb5a2005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:33.878377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e582a80-482b-4a17-a11c-df8deb5a2005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:33.980410 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582a80-482b-4a17-a11c-df8deb5a2005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:33.982012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e582a80-482b-4a17-a11c-df8deb5a2005 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:34.004887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 693/1396] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:34.328152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f7496-d324-4e4d-8376-dab14a2ccaad None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:34.328727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f7496-d324-4e4d-8376-dab14a2ccaad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:34.328874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f7496-d324-4e4d-8376-dab14a2ccaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:34.398533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6b3f7496-d324-4e4d-8376-dab14a2ccaad None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:34.399792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6b3f7496-d324-4e4d-8376-dab14a2ccaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:34.486414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 704/1397] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:21:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:34.529651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ac765-c773-4a3a-b2e4-ab181cbcb6f2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:34.529942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ac765-c773-4a3a-b2e4-ab181cbcb6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:34.530242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ac765-c773-4a3a-b2e4-ab181cbcb6f2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:34.531842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 694/1398] 10.222.0.86 () {54 vars in 943 bytes} [Thu Aug 18 11:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:34.537974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeed65-8923-4384-8c3f-adedd84f4c96 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:34.538265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeed65-8923-4384-8c3f-adedd84f4c96 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:34.538544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeed65-8923-4384-8c3f-adedd84f4c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:34.599242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:34.618744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9deeed65-8923-4384-8c3f-adedd84f4c96 None None] MFA Rules not processed for user `3fecc15bbe7f4a71ac8821ea057153b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:34.619949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9deeed65-8923-4384-8c3f-adedd84f4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:34.730672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 705/1399] 10.222.0.86 () {58 vars in 1040 bytes} [Thu Aug 18 11:21:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:34.740849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ac765-c773-4a3a-b2e4-ab181cbcb6f2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:34.742570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e7ac765-c773-4a3a-b2e4-ab181cbcb6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:34.823946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:34.882319 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ac765-c773-4a3a-b2e4-ab181cbcb6f2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:34.984684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36ea2-346c-40e7-97a7-e6c7ae520eef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:34.985296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36ea2-346c-40e7-97a7-e6c7ae520eef service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:34.985580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36ea2-346c-40e7-97a7-e6c7ae520eef service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:34.985856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36ea2-346c-40e7-97a7-e6c7ae520eef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:34.987490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b9a36ea2-346c-40e7-97a7-e6c7ae520eef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:35.054317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:35.073443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a36ea2-346c-40e7-97a7-e6c7ae520eef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:35.075293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a36ea2-346c-40e7-97a7-e6c7ae520eef service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:35.083942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 695/1400] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:21:36.147238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff8b1-9f79-427d-8606-637879d9aba9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:36.147882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff8b1-9f79-427d-8606-637879d9aba9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:36.147882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ff8b1-9f79-427d-8606-637879d9aba9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:36.152307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 706/1401] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:21:36.158201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd90a-9a0f-4860-a96f-3355b653ea13 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:36.158726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd90a-9a0f-4860-a96f-3355b653ea13 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:36.158726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efd90a-9a0f-4860-a96f-3355b653ea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:36.269616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-84efd90a-9a0f-4860-a96f-3355b653ea13 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:36.271444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-84efd90a-9a0f-4860-a96f-3355b653ea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:36.418522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 696/1402] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:36.747057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff8b1-9f79-427d-8606-637879d9aba9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:36.748758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-347ff8b1-9f79-427d-8606-637879d9aba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:36.869732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:36.923491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ff8b1-9f79-427d-8606-637879d9aba9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:37.049568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5c1a-2693-47a5-8afc-3acc68376a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:37.050184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5c1a-2693-47a5-8afc-3acc68376a1d service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:37.050469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5c1a-2693-47a5-8afc-3acc68376a1d service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:37.050747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5c1a-2693-47a5-8afc-3acc68376a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:37.053016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-72ed5c1a-2693-47a5-8afc-3acc68376a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:37.133645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:37.160419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5c1a-2693-47a5-8afc-3acc68376a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:37.163361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5c1a-2693-47a5-8afc-3acc68376a1d service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:37.187534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 707/1403] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:39.388951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59420-ead2-43f1-a5fc-2d2c45ed2a65 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:39.389856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59420-ead2-43f1-a5fc-2d2c45ed2a65 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:39.390144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c59420-ead2-43f1-a5fc-2d2c45ed2a65 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:39.391498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 697/1404] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:39.397852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1fa65-d27a-455a-a027-a0dfbbfe0167 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:39.398344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1fa65-d27a-455a-a027-a0dfbbfe0167 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:39.399260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1fa65-d27a-455a-a027-a0dfbbfe0167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:39.479721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4fb1fa65-d27a-455a-a027-a0dfbbfe0167 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:39.481100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4fb1fa65-d27a-455a-a027-a0dfbbfe0167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:39.604258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 708/1405] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:39.911266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59420-ead2-43f1-a5fc-2d2c45ed2a65 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:39.912844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06c59420-ead2-43f1-a5fc-2d2c45ed2a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:39.986392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:40.091402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c59420-ead2-43f1-a5fc-2d2c45ed2a65 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:40.228456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74edb-c011-483e-a8b0-541c9f262557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:40.229079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74edb-c011-483e-a8b0-541c9f262557 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:40.229366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74edb-c011-483e-a8b0-541c9f262557 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:40.229635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74edb-c011-483e-a8b0-541c9f262557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:40.231282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-63d74edb-c011-483e-a8b0-541c9f262557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:40.252099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:40.339937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74edb-c011-483e-a8b0-541c9f262557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:40.341634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74edb-c011-483e-a8b0-541c9f262557 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:40.362023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 698/1406] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:42.655244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361318-24a3-45ba-a7e1-ca9576c2ae1a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:42.657181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361318-24a3-45ba-a7e1-ca9576c2ae1a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:42.658416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361318-24a3-45ba-a7e1-ca9576c2ae1a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:42.665614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 709/1407] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:21:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:42.667406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bc056-e544-4102-a85d-c4b7f833438e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:42.667916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bc056-e544-4102-a85d-c4b7f833438e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:42.668025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bc056-e544-4102-a85d-c4b7f833438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:42.769468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8e4bc056-e544-4102-a85d-c4b7f833438e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:42.772099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e4bc056-e544-4102-a85d-c4b7f833438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:42.920829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:42.927400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 699/1408] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:21:43.244398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361318-24a3-45ba-a7e1-ca9576c2ae1a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:21:43.246146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-13361318-24a3-45ba-a7e1-ca9576c2ae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:43.301146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:43.419506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361318-24a3-45ba-a7e1-ca9576c2ae1a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:21:43.561725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5551d-699e-4ab8-b64a-3dbb164a9086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:21:43.562339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5551d-699e-4ab8-b64a-3dbb164a9086 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:43.562653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5551d-699e-4ab8-b64a-3dbb164a9086 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:43.562967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5551d-699e-4ab8-b64a-3dbb164a9086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:43.565978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b1a5551d-699e-4ab8-b64a-3dbb164a9086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:43.576790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:43.683618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5551d-699e-4ab8-b64a-3dbb164a9086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:21:43.685282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5551d-699e-4ab8-b64a-3dbb164a9086 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:21:43.712426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 710/1409] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:21:52.962937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:53.707062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=42 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:59.467177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d880c-9fd4-43a0-8df1-c2d842d90f75 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:59.467687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d880c-9fd4-43a0-8df1-c2d842d90f75 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:59.467687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d880c-9fd4-43a0-8df1-c2d842d90f75 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:59.469025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 700/1410] 10.222.0.86 () {54 vars in 918 bytes} [Thu Aug 18 11:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:59.473947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ca5c-3b99-404d-b9b4-32f87f2f9be5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:59.474347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ca5c-3b99-404d-b9b4-32f87f2f9be5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:59.474494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ca5c-3b99-404d-b9b4-32f87f2f9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:59.551220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-70b1ca5c-3b99-404d-b9b4-32f87f2f9be5 None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:59.552439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-70b1ca5c-3b99-404d-b9b4-32f87f2f9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:59.656820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 711/1411] 10.222.0.86 () {58 vars in 1015 bytes} [Thu Aug 18 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:21:59.671346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0ea1-ff75-4da7-a4fa-3fac424ee319 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:59.671634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0ea1-ff75-4da7-a4fa-3fac424ee319 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:59.671909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0ea1-ff75-4da7-a4fa-3fac424ee319 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:59.673259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 701/1412] 10.222.0.86 () {54 vars in 918 bytes} [Thu Aug 18 11:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:21:59.678838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5664c-6aec-4666-9f9f-f88a8ffae287 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:21:59.679131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5664c-6aec-4666-9f9f-f88a8ffae287 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:21:59.679408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5664c-6aec-4666-9f9f-f88a8ffae287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:21:59.752720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:21:59.755987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-93e5664c-6aec-4666-9f9f-f88a8ffae287 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:21:59.757241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-93e5664c-6aec-4666-9f9f-f88a8ffae287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:21:59.872564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 712/1413] 10.222.0.86 () {58 vars in 1015 bytes} [Thu Aug 18 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:02.287255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025a647-d3e5-45ce-9d39-9a599153d827 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:02.287798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025a647-d3e5-45ce-9d39-9a599153d827 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:02.287798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025a647-d3e5-45ce-9d39-9a599153d827 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:02.289179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:02.294368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca109-6a29-48f8-a3fa-b5b3210592ef None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:02.294808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca109-6a29-48f8-a3fa-b5b3210592ef None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:02.294910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca109-6a29-48f8-a3fa-b5b3210592ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:02.360580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-208ca109-6a29-48f8-a3fa-b5b3210592ef None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:02.361789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-208ca109-6a29-48f8-a3fa-b5b3210592ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:02.419434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:02.461451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:02.749736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025a647-d3e5-45ce-9d39-9a599153d827 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:02.751252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e025a647-d3e5-45ce-9d39-9a599153d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:02.896488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025a647-d3e5-45ce-9d39-9a599153d827 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:02.967612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:03.011109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9c31a-2db0-4429-b0b5-9cb8a8d2f69a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:03.011727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9c31a-2db0-4429-b0b5-9cb8a8d2f69a service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:03.012012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9c31a-2db0-4429-b0b5-9cb8a8d2f69a service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:03.012314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9c31a-2db0-4429-b0b5-9cb8a8d2f69a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:03.013913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-12e9c31a-2db0-4429-b0b5-9cb8a8d2f69a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:03.104055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9c31a-2db0-4429-b0b5-9cb8a8d2f69a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:03.105706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9c31a-2db0-4429-b0b5-9cb8a8d2f69a service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:03.124046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 703/1416] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:04.011813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5402-8ec7-4ef4-8d38-2c8262da76f6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:04.012485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5402-8ec7-4ef4-8d38-2c8262da76f6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:04.012485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb5402-8ec7-4ef4-8d38-2c8262da76f6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:04.013805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:04.018784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406794-8df4-4987-89f5-9d6a465218ca None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:04.019749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406794-8df4-4987-89f5-9d6a465218ca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:04.020101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406794-8df4-4987-89f5-9d6a465218ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:04.096958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-75406794-8df4-4987-89f5-9d6a465218ca None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:04.099019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75406794-8df4-4987-89f5-9d6a465218ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:04.125555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:04.195128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:04.347073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb5402-8ec7-4ef4-8d38-2c8262da76f6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:04.348928 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-abeb5402-8ec7-4ef4-8d38-2c8262da76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:04.493245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb5402-8ec7-4ef4-8d38-2c8262da76f6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:04.533929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:04.607319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5693a7e-7488-42ec-ba0b-e666c0add436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:04.607842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5693a7e-7488-42ec-ba0b-e666c0add436 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:04.608128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5693a7e-7488-42ec-ba0b-e666c0add436 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:04.608435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5693a7e-7488-42ec-ba0b-e666c0add436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:04.610034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b5693a7e-7488-42ec-ba0b-e666c0add436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:04.699002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5693a7e-7488-42ec-ba0b-e666c0add436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:04.700620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5693a7e-7488-42ec-ba0b-e666c0add436 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:04.718736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 715/1419] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:05.607247 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679453-5517-47e7-974c-fdd253864086 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:05.607790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679453-5517-47e7-974c-fdd253864086 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:05.607790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679453-5517-47e7-974c-fdd253864086 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:05.609244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:05.614575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485602c-ee3c-44b3-81f8-1a23c7ae07cc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:05.614984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485602c-ee3c-44b3-81f8-1a23c7ae07cc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:05.615137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485602c-ee3c-44b3-81f8-1a23c7ae07cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:05.670592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:05.693617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8485602c-ee3c-44b3-81f8-1a23c7ae07cc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:05.694852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8485602c-ee3c-44b3-81f8-1a23c7ae07cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:05.794331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:05.948340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679453-5517-47e7-974c-fdd253864086 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:05.949811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7f679453-5517-47e7-974c-fdd253864086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:06.095542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679453-5517-47e7-974c-fdd253864086 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:06.107570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:06.208947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f29fd-c404-45aa-8682-d1e7890cdb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:06.209559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f29fd-c404-45aa-8682-d1e7890cdb95 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:06.209838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f29fd-c404-45aa-8682-d1e7890cdb95 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:06.210112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f29fd-c404-45aa-8682-d1e7890cdb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:06.211756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-700f29fd-c404-45aa-8682-d1e7890cdb95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:06.301064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f29fd-c404-45aa-8682-d1e7890cdb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:06.302669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f29fd-c404-45aa-8682-d1e7890cdb95 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:06.320506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 706/1422] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:07.183824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21135b1e-4416-4d8d-96f4-85f2a1ae6826 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:07.184444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21135b1e-4416-4d8d-96f4-85f2a1ae6826 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:07.184444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21135b1e-4416-4d8d-96f4-85f2a1ae6826 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:07.185738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:07.191459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105447c7-21c9-42e6-90b3-c671cfd1636f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:07.192432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105447c7-21c9-42e6-90b3-c671cfd1636f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:07.192733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105447c7-21c9-42e6-90b3-c671cfd1636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:07.213715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:07.270871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-105447c7-21c9-42e6-90b3-c671cfd1636f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:07.272069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-105447c7-21c9-42e6-90b3-c671cfd1636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:07.366481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:07.518077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21135b1e-4416-4d8d-96f4-85f2a1ae6826 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:07.520054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-21135b1e-4416-4d8d-96f4-85f2a1ae6826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:07.636186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:07.674116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21135b1e-4416-4d8d-96f4-85f2a1ae6826 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:07.788494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77383c82-4463-4e1a-867f-a07c6e513cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:07.789105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77383c82-4463-4e1a-867f-a07c6e513cfd service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:07.789430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77383c82-4463-4e1a-867f-a07c6e513cfd service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:07.789705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77383c82-4463-4e1a-867f-a07c6e513cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:07.791290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-77383c82-4463-4e1a-867f-a07c6e513cfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:07.866803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:07.880783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77383c82-4463-4e1a-867f-a07c6e513cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:07.882436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77383c82-4463-4e1a-867f-a07c6e513cfd service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:07.900420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 718/1425] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:08.769887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c119f-29e6-44e0-8b51-44d4267503a7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:08.770495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c119f-29e6-44e0-8b51-44d4267503a7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:08.770495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c119f-29e6-44e0-8b51-44d4267503a7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:08.771747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:08.776914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3432e-a2ec-4054-abc1-b614b59473dd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:08.777362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3432e-a2ec-4054-abc1-b614b59473dd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:08.777494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3432e-a2ec-4054-abc1-b614b59473dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:08.852794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e9d3432e-a2ec-4054-abc1-b614b59473dd None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:08.854001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e9d3432e-a2ec-4054-abc1-b614b59473dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:08.951682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:09.103616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c119f-29e6-44e0-8b51-44d4267503a7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:09.105167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-524c119f-29e6-44e0-8b51-44d4267503a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:09.192439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:09.256644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c119f-29e6-44e0-8b51-44d4267503a7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:09.369503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a190d0-8ff3-4776-835d-1633c6c9cd58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:09.370120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a190d0-8ff3-4776-835d-1633c6c9cd58 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:09.370406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a190d0-8ff3-4776-835d-1633c6c9cd58 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:09.370690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a190d0-8ff3-4776-835d-1633c6c9cd58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:09.372339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87a190d0-8ff3-4776-835d-1633c6c9cd58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:09.427195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:09.471760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a190d0-8ff3-4776-835d-1633c6c9cd58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:09.473985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a190d0-8ff3-4776-835d-1633c6c9cd58 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:09.492989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 709/1428] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:10.406450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221427b-7983-4dc3-ba1d-6d2743d8ac56 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:10.407012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221427b-7983-4dc3-ba1d-6d2743d8ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:10.407012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221427b-7983-4dc3-ba1d-6d2743d8ac56 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:10.408482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:10.413433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e4c92-4182-4cf2-9323-76c036448db7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:10.413832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e4c92-4182-4cf2-9323-76c036448db7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:10.413986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e4c92-4182-4cf2-9323-76c036448db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:10.495915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-830e4c92-4182-4cf2-9323-76c036448db7 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:10.497138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-830e4c92-4182-4cf2-9323-76c036448db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:10.598721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:10.751400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221427b-7983-4dc3-ba1d-6d2743d8ac56 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:10.752868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2221427b-7983-4dc3-ba1d-6d2743d8ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:10.803979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:10.905299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221427b-7983-4dc3-ba1d-6d2743d8ac56 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:11.030079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5dafe-ca7c-4764-a089-fc4f4ec398eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:11.030645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5dafe-ca7c-4764-a089-fc4f4ec398eb service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:11.030954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5dafe-ca7c-4764-a089-fc4f4ec398eb service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:11.031322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5dafe-ca7c-4764-a089-fc4f4ec398eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:11.033104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3fa5dafe-ca7c-4764-a089-fc4f4ec398eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:11.040717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:11.129094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5dafe-ca7c-4764-a089-fc4f4ec398eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:11.130708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5dafe-ca7c-4764-a089-fc4f4ec398eb service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:11.150534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 721/1431] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:12.029589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3889a5-9350-4e26-9723-f55723cf7037 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:12.030155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3889a5-9350-4e26-9723-f55723cf7037 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:12.030648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3889a5-9350-4e26-9723-f55723cf7037 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:12.031553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:12.037035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835738c-8a3e-41ea-9ad4-3077bfa9f0cc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:12.037497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835738c-8a3e-41ea-9ad4-3077bfa9f0cc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:12.037588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835738c-8a3e-41ea-9ad4-3077bfa9f0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:12.117971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8835738c-8a3e-41ea-9ad4-3077bfa9f0cc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:12.119359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8835738c-8a3e-41ea-9ad4-3077bfa9f0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:12.193560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:12.225769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:12.379298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3889a5-9350-4e26-9723-f55723cf7037 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:12.380908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dd3889a5-9350-4e26-9723-f55723cf7037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:12.399035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:12.531093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3889a5-9350-4e26-9723-f55723cf7037 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:12.620521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:12.647198 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a25f1-ba76-41ed-bf2e-a22d46b8675e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:12.647733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a25f1-ba76-41ed-bf2e-a22d46b8675e service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:12.648020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a25f1-ba76-41ed-bf2e-a22d46b8675e service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:12.648339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a25f1-ba76-41ed-bf2e-a22d46b8675e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:12.650226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e32a25f1-ba76-41ed-bf2e-a22d46b8675e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:12.742071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a25f1-ba76-41ed-bf2e-a22d46b8675e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:12.743678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a25f1-ba76-41ed-bf2e-a22d46b8675e service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:12.761921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 712/1434] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:13.652783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9100bc-66fd-44e6-9d78-aae128f63e72 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:13.653359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9100bc-66fd-44e6-9d78-aae128f63e72 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:13.653359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9100bc-66fd-44e6-9d78-aae128f63e72 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:13.654689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:13.660680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c899-e3de-4f7e-83e6-79b34969d380 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:13.661106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c899-e3de-4f7e-83e6-79b34969d380 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:13.661214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c899-e3de-4f7e-83e6-79b34969d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:13.736675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-41f7c899-e3de-4f7e-83e6-79b34969d380 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:13.737942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-41f7c899-e3de-4f7e-83e6-79b34969d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:13.779262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:13.833484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:13.988580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9100bc-66fd-44e6-9d78-aae128f63e72 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:13.989990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9a9100bc-66fd-44e6-9d78-aae128f63e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:14.138348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9100bc-66fd-44e6-9d78-aae128f63e72 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:14.192563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:14.251035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33bba3-11bb-4a2b-9749-b16947a460d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:14.251570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33bba3-11bb-4a2b-9749-b16947a460d6 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:14.251854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33bba3-11bb-4a2b-9749-b16947a460d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:14.252131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33bba3-11bb-4a2b-9749-b16947a460d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:14.254489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fc33bba3-11bb-4a2b-9749-b16947a460d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:14.343251 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33bba3-11bb-4a2b-9749-b16947a460d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:14.344878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33bba3-11bb-4a2b-9749-b16947a460d6 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:14.363144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 724/1437] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:15.217408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f890a-c1a1-41fd-9791-fb8bfb3c41c1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:15.217837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f890a-c1a1-41fd-9791-fb8bfb3c41c1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:15.217966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f890a-c1a1-41fd-9791-fb8bfb3c41c1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:15.219343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:15.225090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f88056-4b8e-4cb0-aa20-2c9d9a1e8d59 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:15.225563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f88056-4b8e-4cb0-aa20-2c9d9a1e8d59 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:15.225662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f88056-4b8e-4cb0-aa20-2c9d9a1e8d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:15.302006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f0f88056-4b8e-4cb0-aa20-2c9d9a1e8d59 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:15.303222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0f88056-4b8e-4cb0-aa20-2c9d9a1e8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:15.305313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:15.401335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:15.552954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f890a-c1a1-41fd-9791-fb8bfb3c41c1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:15.554450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e50f890a-c1a1-41fd-9791-fb8bfb3c41c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:15.700731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f890a-c1a1-41fd-9791-fb8bfb3c41c1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:15.727447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:15.811996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6acb9-6925-4f3e-9b0b-824482484a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:15.812549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6acb9-6925-4f3e-9b0b-824482484a11 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:15.812831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6acb9-6925-4f3e-9b0b-824482484a11 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:15.813105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6acb9-6925-4f3e-9b0b-824482484a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:15.814694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-80c6acb9-6925-4f3e-9b0b-824482484a11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:15.903652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6acb9-6925-4f3e-9b0b-824482484a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:15.905273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6acb9-6925-4f3e-9b0b-824482484a11 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:15.922811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 715/1440] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:17.737807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebf5a0-c97a-416a-870d-1dd624e52498 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:17.738389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebf5a0-c97a-416a-870d-1dd624e52498 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:17.738389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebf5a0-c97a-416a-870d-1dd624e52498 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:17.739711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:17.745014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937a0a-42f9-41b2-987f-4ea659b4c1fb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:17.745440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937a0a-42f9-41b2-987f-4ea659b4c1fb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:17.745546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937a0a-42f9-41b2-987f-4ea659b4c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:17.786750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:17.811131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-98937a0a-42f9-41b2-987f-4ea659b4c1fb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:17.812366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-98937a0a-42f9-41b2-987f-4ea659b4c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:17.907662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:18.199216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebf5a0-c97a-416a-870d-1dd624e52498 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:18.201465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fbebf5a0-c97a-416a-870d-1dd624e52498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:18.306788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebf5a0-c97a-416a-870d-1dd624e52498 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:18.339658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:18.380550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8045cf-a86c-4627-998c-e11b5ff8a112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:18.381155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8045cf-a86c-4627-998c-e11b5ff8a112 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:18.381437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8045cf-a86c-4627-998c-e11b5ff8a112 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:18.381713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8045cf-a86c-4627-998c-e11b5ff8a112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:18.383314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5f8045cf-a86c-4627-998c-e11b5ff8a112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:18.491041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8045cf-a86c-4627-998c-e11b5ff8a112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:18.492489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8045cf-a86c-4627-998c-e11b5ff8a112 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:18.511114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 727/1443] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:20.569366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f958a7-432c-468c-bbea-e361e7044285 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:20.569902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f958a7-432c-468c-bbea-e361e7044285 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:20.569902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f958a7-432c-468c-bbea-e361e7044285 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:20.571246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:20.576595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6da15-693e-4a9f-a495-6986376c7903 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:20.577071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6da15-693e-4a9f-a495-6986376c7903 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:20.577269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6da15-693e-4a9f-a495-6986376c7903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:20.642306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fcd6da15-693e-4a9f-a495-6986376c7903 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:20.643503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fcd6da15-693e-4a9f-a495-6986376c7903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:20.656883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:20.743020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:21.025310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f958a7-432c-468c-bbea-e361e7044285 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:21.026832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-71f958a7-432c-468c-bbea-e361e7044285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:21.129578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f958a7-432c-468c-bbea-e361e7044285 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:21.141732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:21.207860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edd43e-bddb-4a2b-aef6-449b4365886e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:21.209140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd43e-bddb-4a2b-aef6-449b4365886e service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:21.209253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd43e-bddb-4a2b-aef6-449b4365886e service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:21.209473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd43e-bddb-4a2b-aef6-449b4365886e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:21.211216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-27edd43e-bddb-4a2b-aef6-449b4365886e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:21.320802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edd43e-bddb-4a2b-aef6-449b4365886e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:21.322245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edd43e-bddb-4a2b-aef6-449b4365886e service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:21.340977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 718/1446] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:23.682809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38784a-0a3f-4a17-b596-4dc2fec4e8ee None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:23.683347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38784a-0a3f-4a17-b596-4dc2fec4e8ee None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:23.683347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38784a-0a3f-4a17-b596-4dc2fec4e8ee None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:23.684746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:23.690105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e30d6-4198-4d41-8e09-d42d626ee7c4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:23.690521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e30d6-4198-4d41-8e09-d42d626ee7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:23.690659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e30d6-4198-4d41-8e09-d42d626ee7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:23.741005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:23.758790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d86e30d6-4198-4d41-8e09-d42d626ee7c4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:23.759978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d86e30d6-4198-4d41-8e09-d42d626ee7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:23.855914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:24.144935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38784a-0a3f-4a17-b596-4dc2fec4e8ee None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:24.146481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0a38784a-0a3f-4a17-b596-4dc2fec4e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:24.251048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38784a-0a3f-4a17-b596-4dc2fec4e8ee None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:24.290837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:24.324757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad61774-1297-4113-b26c-634912b906ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:24.325362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61774-1297-4113-b26c-634912b906ce service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:24.325646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61774-1297-4113-b26c-634912b906ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:24.325922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad61774-1297-4113-b26c-634912b906ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:24.328331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5ad61774-1297-4113-b26c-634912b906ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:24.435824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad61774-1297-4113-b26c-634912b906ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:24.437207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad61774-1297-4113-b26c-634912b906ce service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:24.455363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 730/1449] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:26.489066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf474-7b3a-417c-8a25-e71347316443 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:26.489633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf474-7b3a-417c-8a25-e71347316443 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:26.489633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf474-7b3a-417c-8a25-e71347316443 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:26.490911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:26.496725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f7f8a-4759-4c82-ba4c-a1ade6629796 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:26.497186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f7f8a-4759-4c82-ba4c-a1ade6629796 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:26.497295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f7f8a-4759-4c82-ba4c-a1ade6629796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:26.563133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ee2f7f8a-4759-4c82-ba4c-a1ade6629796 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:26.564395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ee2f7f8a-4759-4c82-ba4c-a1ade6629796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:26.586846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:26.664422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:26.945164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf474-7b3a-417c-8a25-e71347316443 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:26.946698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-04cbf474-7b3a-417c-8a25-e71347316443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:27.049263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf474-7b3a-417c-8a25-e71347316443 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:27.069710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:27.124161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070ce06-78c4-4e2f-984f-c593ac6940c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:27.124797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ce06-78c4-4e2f-984f-c593ac6940c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:27.125079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ce06-78c4-4e2f-984f-c593ac6940c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:27.125354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ce06-78c4-4e2f-984f-c593ac6940c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:27.126946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0070ce06-78c4-4e2f-984f-c593ac6940c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:27.239430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070ce06-78c4-4e2f-984f-c593ac6940c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:27.240917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070ce06-78c4-4e2f-984f-c593ac6940c8 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:27.260470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 721/1452] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:29.282761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07706ce-9fe9-48a6-85a7-db489df3d9fd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:29.283315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07706ce-9fe9-48a6-85a7-db489df3d9fd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:29.283414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07706ce-9fe9-48a6-85a7-db489df3d9fd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:29.285298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:29.290725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72d119-6076-460a-bf1a-71d4d24af7dc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:29.291165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72d119-6076-460a-bf1a-71d4d24af7dc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:29.291263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72d119-6076-460a-bf1a-71d4d24af7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:29.354595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:29.357258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6e72d119-6076-460a-bf1a-71d4d24af7dc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:29.358446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6e72d119-6076-460a-bf1a-71d4d24af7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:29.455743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:29.740975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07706ce-9fe9-48a6-85a7-db489df3d9fd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:29.742503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d07706ce-9fe9-48a6-85a7-db489df3d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:29.845748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07706ce-9fe9-48a6-85a7-db489df3d9fd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:29.893814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:29.919174 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b27202-b980-492f-bd4c-c458a41b0f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:29.919778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b27202-b980-492f-bd4c-c458a41b0f81 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:29.920059 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b27202-b980-492f-bd4c-c458a41b0f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:29.920367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b27202-b980-492f-bd4c-c458a41b0f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:29.921942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a6b27202-b980-492f-bd4c-c458a41b0f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:30.029242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b27202-b980-492f-bd4c-c458a41b0f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:30.030591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b27202-b980-492f-bd4c-c458a41b0f81 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:30.048868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 733/1455] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:32.013111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e20c-a296-4256-81ce-a2e6003296fa None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:32.013647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e20c-a296-4256-81ce-a2e6003296fa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:32.013647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41e20c-a296-4256-81ce-a2e6003296fa None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:32.014987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:32.020161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9213a-5f80-4496-9eb1-6e8b4c856c30 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:32.020625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9213a-5f80-4496-9eb1-6e8b4c856c30 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:32.020790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9213a-5f80-4496-9eb1-6e8b4c856c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:32.088108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-eab9213a-5f80-4496-9eb1-6e8b4c856c30 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:32.089342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-eab9213a-5f80-4496-9eb1-6e8b4c856c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:32.119317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:32.187329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:32.475174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41e20c-a296-4256-81ce-a2e6003296fa None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:32.476738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6a41e20c-a296-4256-81ce-a2e6003296fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:32.579383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41e20c-a296-4256-81ce-a2e6003296fa None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:32.607593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:32.653055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8d2ec-66dc-4786-9adf-12f1fb0229e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:32.653657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d2ec-66dc-4786-9adf-12f1fb0229e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:32.653935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d2ec-66dc-4786-9adf-12f1fb0229e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:32.654204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8d2ec-66dc-4786-9adf-12f1fb0229e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:32.655771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-42c8d2ec-66dc-4786-9adf-12f1fb0229e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:32.763452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8d2ec-66dc-4786-9adf-12f1fb0229e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:32.764915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8d2ec-66dc-4786-9adf-12f1fb0229e5 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:32.783975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 724/1458] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:34.766119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9cd5b-4596-43d8-973e-49f7434ca909 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:34.766691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9cd5b-4596-43d8-973e-49f7434ca909 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:34.766691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9cd5b-4596-43d8-973e-49f7434ca909 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:34.768032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:34.773524 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61cbbe-e153-468c-beeb-d4c2d68ed59d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:34.774289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61cbbe-e153-468c-beeb-d4c2d68ed59d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:34.774389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61cbbe-e153-468c-beeb-d4c2d68ed59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:34.839727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8f61cbbe-e153-468c-beeb-d4c2d68ed59d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:34.840974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8f61cbbe-e153-468c-beeb-d4c2d68ed59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:34.849900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:34.938084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:35.228608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9cd5b-4596-43d8-973e-49f7434ca909 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:35.230136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1ae9cd5b-4596-43d8-973e-49f7434ca909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:35.334909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9cd5b-4596-43d8-973e-49f7434ca909 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:35.390546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:35.409192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2296672-9a09-46fb-bcbe-db5848d7c1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:35.410399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2296672-9a09-46fb-bcbe-db5848d7c1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:35.410399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2296672-9a09-46fb-bcbe-db5848d7c1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:35.410399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2296672-9a09-46fb-bcbe-db5848d7c1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:35.412062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2296672-9a09-46fb-bcbe-db5848d7c1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:35.518324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2296672-9a09-46fb-bcbe-db5848d7c1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:35.520547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2296672-9a09-46fb-bcbe-db5848d7c1b6 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:35.539172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 736/1461] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:37.509062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354148-63c6-418e-8834-cb25acabb219 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:37.509596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354148-63c6-418e-8834-cb25acabb219 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:37.509596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd354148-63c6-418e-8834-cb25acabb219 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:37.510855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:22:37.516102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed3140-5e73-407e-914f-516057aa9a59 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:37.516561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed3140-5e73-407e-914f-516057aa9a59 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:37.516682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed3140-5e73-407e-914f-516057aa9a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:37.583637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-82ed3140-5e73-407e-914f-516057aa9a59 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:37.584884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-82ed3140-5e73-407e-914f-516057aa9a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:37.623698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:37.682771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:37.965895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd354148-63c6-418e-8834-cb25acabb219 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:37.967448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fd354148-63c6-418e-8834-cb25acabb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:38.070256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd354148-63c6-418e-8834-cb25acabb219 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:38.109557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:38.145446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f5469-faa7-4c8b-b597-d7597766a9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:38.146059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f5469-faa7-4c8b-b597-d7597766a9bd service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:38.146344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f5469-faa7-4c8b-b597-d7597766a9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:38.146620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f5469-faa7-4c8b-b597-d7597766a9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:38.148242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-564f5469-faa7-4c8b-b597-d7597766a9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:38.256952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f5469-faa7-4c8b-b597-d7597766a9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:38.258360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f5469-faa7-4c8b-b597-d7597766a9bd service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:38.279991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 727/1464] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:40.240438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735404d-52a0-4154-8fd0-1b56cf62a865 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:40.241006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735404d-52a0-4154-8fd0-1b56cf62a865 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:40.241006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735404d-52a0-4154-8fd0-1b56cf62a865 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:40.242352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:40.247425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787049f-926f-40c0-84c4-8b50ced3d865 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:40.247859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787049f-926f-40c0-84c4-8b50ced3d865 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:40.247990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787049f-926f-40c0-84c4-8b50ced3d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:40.313931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c787049f-926f-40c0-84c4-8b50ced3d865 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:40.315157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c787049f-926f-40c0-84c4-8b50ced3d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:40.333987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:40.413906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:40.695110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735404d-52a0-4154-8fd0-1b56cf62a865 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:40.696663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3735404d-52a0-4154-8fd0-1b56cf62a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:40.800616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735404d-52a0-4154-8fd0-1b56cf62a865 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:40.866662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:40.873551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9295db-ca0a-4a57-a60e-3b185adfa1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:40.874152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9295db-ca0a-4a57-a60e-3b185adfa1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:40.874458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9295db-ca0a-4a57-a60e-3b185adfa1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:40.874728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9295db-ca0a-4a57-a60e-3b185adfa1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:40.876361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3a9295db-ca0a-4a57-a60e-3b185adfa1f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:40.985008 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9295db-ca0a-4a57-a60e-3b185adfa1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:40.986336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9295db-ca0a-4a57-a60e-3b185adfa1f2 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:41.005397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 739/1467] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:43.014352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2964-6fec-462c-9316-59e5442b7364 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:43.014969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2964-6fec-462c-9316-59e5442b7364 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:43.014969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d2964-6fec-462c-9316-59e5442b7364 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:43.016291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:22:43.022103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610468cc-b791-43ec-ad19-3f616d953d28 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:43.022520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610468cc-b791-43ec-ad19-3f616d953d28 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:43.022656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610468cc-b791-43ec-ad19-3f616d953d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:43.087818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-610468cc-b791-43ec-ad19-3f616d953d28 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:22:43.089033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-610468cc-b791-43ec-ad19-3f616d953d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:43.137664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:43.186908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:22:43.481329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2964-6fec-462c-9316-59e5442b7364 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:22:43.482874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f33d2964-6fec-462c-9316-59e5442b7364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:43.586664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d2964-6fec-462c-9316-59e5442b7364 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:22:43.633477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:43.659825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a5545-5f67-4a21-a824-0b031c3ee892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:22:43.660461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a5545-5f67-4a21-a824-0b031c3ee892 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:22:43.660743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a5545-5f67-4a21-a824-0b031c3ee892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:22:43.661040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a5545-5f67-4a21-a824-0b031c3ee892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:22:43.662642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3a3a5545-5f67-4a21-a824-0b031c3ee892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:22:43.771392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a5545-5f67-4a21-a824-0b031c3ee892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:22:43.772871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a5545-5f67-4a21-a824-0b031c3ee892 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:22:43.791686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 730/1470] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:22:53.185102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=22 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:22:53.789421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=66 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:03.411559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa332e5-15f5-4a4a-965a-f8a259dcb19d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:03.412105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa332e5-15f5-4a4a-965a-f8a259dcb19d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:03.412105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa332e5-15f5-4a4a-965a-f8a259dcb19d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:03.413539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 741/1471] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:03.418768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9b130-5a19-418b-9ba0-374ec47702c3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:03.419148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9b130-5a19-418b-9ba0-374ec47702c3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:03.419318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9b130-5a19-418b-9ba0-374ec47702c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:03.484090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c2c9b130-5a19-418b-9ba0-374ec47702c3 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:03.485237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c2c9b130-5a19-418b-9ba0-374ec47702c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:03.581520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 731/1472] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:03.881168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f20d-ee98-4fef-9e2d-e4533706fefc None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:03.881460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f20d-ee98-4fef-9e2d-e4533706fefc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:03.881738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f20d-ee98-4fef-9e2d-e4533706fefc None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:03.883071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 742/1473] 10.222.0.86 () {54 vars in 967 bytes} [Thu Aug 18 11:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:03.887986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2286f-f61e-4fd6-8b8e-5350a1ede8b9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:03.888312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2286f-f61e-4fd6-8b8e-5350a1ede8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:03.888620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2286f-f61e-4fd6-8b8e-5350a1ede8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:03.965587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-04e2286f-f61e-4fd6-8b8e-5350a1ede8b9 None None] MFA Rules not processed for user `514818f5b23c4234b259e5b47e698a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:03.966790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-04e2286f-f61e-4fd6-8b8e-5350a1ede8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:03.987965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:04.043689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 732/1474] 10.222.0.86 () {58 vars in 1064 bytes} [Thu Aug 18 11:23:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:04.052091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f20d-ee98-4fef-9e2d-e4533706fefc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:23:04.053624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0159f20d-ee98-4fef-9e2d-e4533706fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:04.157010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f20d-ee98-4fef-9e2d-e4533706fefc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:23:04.233537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e46aa-90e4-4f38-9832-9d2af913f4e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514818f5b23c4234b259e5b47e698a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:23:04.234148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e46aa-90e4-4f38-9832-9d2af913f4e9 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:04.234427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e46aa-90e4-4f38-9832-9d2af913f4e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:04.234698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e46aa-90e4-4f38-9832-9d2af913f4e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:04.236359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4a7e46aa-90e4-4f38-9832-9d2af913f4e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:04.290699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:04.345240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e46aa-90e4-4f38-9832-9d2af913f4e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:23:04.347340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e46aa-90e4-4f38-9832-9d2af913f4e9 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:23:04.365788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 743/1475] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:23:06.374327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786c2ac-9cc8-4dc6-8cbd-b829f350d195 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:06.374826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786c2ac-9cc8-4dc6-8cbd-b829f350d195 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:06.374826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786c2ac-9cc8-4dc6-8cbd-b829f350d195 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:06.376149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 733/1476] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:06.382107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d80d9-a150-4ba8-ae0f-a8a0b6571f20 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:06.382587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d80d9-a150-4ba8-ae0f-a8a0b6571f20 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:06.382695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d80d9-a150-4ba8-ae0f-a8a0b6571f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:06.449077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-278d80d9-a150-4ba8-ae0f-a8a0b6571f20 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:06.450365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-278d80d9-a150-4ba8-ae0f-a8a0b6571f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:06.546543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 744/1477] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:06.828314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786c2ac-9cc8-4dc6-8cbd-b829f350d195 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:23:06.830505 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3786c2ac-9cc8-4dc6-8cbd-b829f350d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:06.957930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786c2ac-9cc8-4dc6-8cbd-b829f350d195 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:23:07.006318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:07.050603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e68b4-ebae-46ab-a265-eb6e72bdc237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:23:07.051216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e68b4-ebae-46ab-a265-eb6e72bdc237 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:07.051498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e68b4-ebae-46ab-a265-eb6e72bdc237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:07.051775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e68b4-ebae-46ab-a265-eb6e72bdc237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:07.052445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e68b4-ebae-46ab-a265-eb6e72bdc237 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:23:07.054231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-ec6e68b4-ebae-46ab-a265-eb6e72bdc237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:23:07.054231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:23:07.054231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:23:07.055392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e68b4-ebae-46ab-a265-eb6e72bdc237 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:23:07.074743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 734/1478] 10.222.0.86 () {56 vars in 1108 bytes} [Thu Aug 18 11:23:06 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:23:09.018006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48138-3e0c-4478-91a6-194f00424dca None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:09.018861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48138-3e0c-4478-91a6-194f00424dca None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:09.018861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e48138-3e0c-4478-91a6-194f00424dca None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:09.020162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 745/1479] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:09.025833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee81c2-e497-46b0-8f35-433c2b3b6b0d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:09.026249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee81c2-e497-46b0-8f35-433c2b3b6b0d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:09.026389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee81c2-e497-46b0-8f35-433c2b3b6b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:09.093912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-abee81c2-e497-46b0-8f35-433c2b3b6b0d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:09.095174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-abee81c2-e497-46b0-8f35-433c2b3b6b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:09.193265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 735/1480] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:09.490172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48138-3e0c-4478-91a6-194f00424dca None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:23:09.491689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b0e48138-3e0c-4478-91a6-194f00424dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:09.502384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:09.640522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e48138-3e0c-4478-91a6-194f00424dca None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:23:09.721477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:09.755823 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d2dc7-766e-4bf7-aa51-a36240476f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:23:09.756455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2dc7-766e-4bf7-aa51-a36240476f3a service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:09.756733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2dc7-766e-4bf7-aa51-a36240476f3a service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:09.757006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2dc7-766e-4bf7-aa51-a36240476f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:09.759382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-441d2dc7-766e-4bf7-aa51-a36240476f3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:09.847897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d2dc7-766e-4bf7-aa51-a36240476f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:23:09.849515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d2dc7-766e-4bf7-aa51-a36240476f3a service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:23:09.868180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 746/1481] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:23:12.027123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e457-b515-4fc7-9014-54e355b40930 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:12.027737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e457-b515-4fc7-9014-54e355b40930 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:12.027850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e457-b515-4fc7-9014-54e355b40930 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:12.032239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 736/1482] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:12.036177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f302-bcd3-4ae2-aabb-3baefb633296 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:12.036177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f302-bcd3-4ae2-aabb-3baefb633296 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:12.036177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f302-bcd3-4ae2-aabb-3baefb633296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:12.104669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0d17f302-bcd3-4ae2-aabb-3baefb633296 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:12.105950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0d17f302-bcd3-4ae2-aabb-3baefb633296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:12.152654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:12.203838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 747/1483] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:12.495795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e457-b515-4fc7-9014-54e355b40930 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:23:12.497465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc14e457-b515-4fc7-9014-54e355b40930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:12.523871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:12.602472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e457-b515-4fc7-9014-54e355b40930 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:23:12.675344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf33f8-422f-47e2-8b1a-45875ad3785e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:23:12.675958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf33f8-422f-47e2-8b1a-45875ad3785e service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:12.676277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf33f8-422f-47e2-8b1a-45875ad3785e service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:12.676557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf33f8-422f-47e2-8b1a-45875ad3785e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:12.678158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ebf33f8-422f-47e2-8b1a-45875ad3785e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:12.751297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:12.787084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf33f8-422f-47e2-8b1a-45875ad3785e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:23:12.788578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf33f8-422f-47e2-8b1a-45875ad3785e service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:23:12.810064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 737/1484] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:23:14.762467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2d4b-6e8e-4fb8-b3ef-10798975edf8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:14.763033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2d4b-6e8e-4fb8-b3ef-10798975edf8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:14.763033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2d4b-6e8e-4fb8-b3ef-10798975edf8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:14.764406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 748/1485] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:14.770148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4817c4-cff7-4e92-8996-58d044a38238 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:14.770555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4817c4-cff7-4e92-8996-58d044a38238 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:14.770739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4817c4-cff7-4e92-8996-58d044a38238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:14.836624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cb4817c4-cff7-4e92-8996-58d044a38238 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:14.837831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb4817c4-cff7-4e92-8996-58d044a38238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:14.933775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 738/1486] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:15.222585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2d4b-6e8e-4fb8-b3ef-10798975edf8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:23:15.224149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cdae2d4b-6e8e-4fb8-b3ef-10798975edf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:15.330856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2d4b-6e8e-4fb8-b3ef-10798975edf8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:23:15.403156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:15.404952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d3b84-049c-4174-bd01-646e5fe1297c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:23:15.405556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3b84-049c-4174-bd01-646e5fe1297c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:15.405837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3b84-049c-4174-bd01-646e5fe1297c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:15.406114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3b84-049c-4174-bd01-646e5fe1297c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:15.407720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-113d3b84-049c-4174-bd01-646e5fe1297c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:15.516530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d3b84-049c-4174-bd01-646e5fe1297c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:23:15.518186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d3b84-049c-4174-bd01-646e5fe1297c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:23:15.536556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 749/1487] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:23:17.552370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6fd2-5f23-47b9-9e9f-eb8e080dcff9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:17.552924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6fd2-5f23-47b9-9e9f-eb8e080dcff9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:17.552924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6fd2-5f23-47b9-9e9f-eb8e080dcff9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:17.554304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 739/1488] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:17.559514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395c3b-7848-47b8-8cee-a73a5d37f59a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:17.559917 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395c3b-7848-47b8-8cee-a73a5d37f59a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:17.560085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395c3b-7848-47b8-8cee-a73a5d37f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:17.625133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-70395c3b-7848-47b8-8cee-a73a5d37f59a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:17.626895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-70395c3b-7848-47b8-8cee-a73a5d37f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:17.680479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:17.725293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 750/1489] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:18.017915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f6fd2-5f23-47b9-9e9f-eb8e080dcff9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:23:18.019500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-591f6fd2-5f23-47b9-9e9f-eb8e080dcff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:18.055924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:18.127217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f6fd2-5f23-47b9-9e9f-eb8e080dcff9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:23:18.202877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70fdf-d46a-4bf0-b6e9-b051735abd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:23:18.203483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70fdf-d46a-4bf0-b6e9-b051735abd28 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:18.203760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70fdf-d46a-4bf0-b6e9-b051735abd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:18.204028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70fdf-d46a-4bf0-b6e9-b051735abd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:18.206053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e3e70fdf-d46a-4bf0-b6e9-b051735abd28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:18.287693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:18.317728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e70fdf-d46a-4bf0-b6e9-b051735abd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:23:18.319213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e70fdf-d46a-4bf0-b6e9-b051735abd28 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:23:18.337381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 740/1490] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:23:20.610215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb880-602a-4fa4-9723-c430b37931e8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:20.611584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb880-602a-4fa4-9723-c430b37931e8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:20.611584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb880-602a-4fa4-9723-c430b37931e8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:20.612820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 751/1491] 10.222.0.86 () {54 vars in 927 bytes} [Thu Aug 18 11:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:23:20.618064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a2b2-8270-4dc7-8a50-0a91a13687f0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:20.618469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a2b2-8270-4dc7-8a50-0a91a13687f0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:20.618626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a2b2-8270-4dc7-8a50-0a91a13687f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:20.684986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-33e8a2b2-8270-4dc7-8a50-0a91a13687f0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:23:20.686198 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-33e8a2b2-8270-4dc7-8a50-0a91a13687f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:20.783033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 741/1492] 10.222.0.86 () {58 vars in 1024 bytes} [Thu Aug 18 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:23:21.070662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb880-602a-4fa4-9723-c430b37931e8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:23:21.072317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f92bb880-602a-4fa4-9723-c430b37931e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:21.175904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb880-602a-4fa4-9723-c430b37931e8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:23:21.250672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6307b9-6017-420e-8fdb-aac035c857b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:23:21.251863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6307b9-6017-420e-8fdb-aac035c857b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:23:21.252147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6307b9-6017-420e-8fdb-aac035c857b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:23:21.252456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6307b9-6017-420e-8fdb-aac035c857b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:23:21.254093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d6307b9-6017-420e-8fdb-aac035c857b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:23:21.263540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:21.366595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6307b9-6017-420e-8fdb-aac035c857b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:23:21.368021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6307b9-6017-420e-8fdb-aac035c857b2 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:23:21.388003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 752/1493] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:23:30.780662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=82 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:31.385617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=50 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:41.548572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:41.549169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:41.549169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:41.626047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:24:41.627253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:41.724554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 742/1494] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:24:41.732588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9e49-230d-4804-ad54-b6e70e2a897a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:41.733097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9e49-230d-4804-ad54-b6e70e2a897a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:41.733224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9e49-230d-4804-ad54-b6e70e2a897a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:41.809585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c3ba9e49-230d-4804-ad54-b6e70e2a897a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:24:41.810743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c3ba9e49-230d-4804-ad54-b6e70e2a897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:41.907171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 753/1495] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:24:41.912008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:41.913273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:41.924613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7508c-b585-4930-a0da-1c2af271fab2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:41.985621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:42.020123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:42.021074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:42.021480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:42.021761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:42.022417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:24:42.022725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:42.023760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:42.023760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:24:42.023760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:24:42.024904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:42.037938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 743/1496] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:24:42.045876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9e49-230d-4804-ad54-b6e70e2a897a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:42.055159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9e49-230d-4804-ad54-b6e70e2a897a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:42.117161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:42.151550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:42.152159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:42.152470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:42.152751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:42.153386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:42.155313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:42.155313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 18 11:24:42.155313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: Aug 18 11:24:42.156602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:42.375776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 754/1497] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:24:42 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:24:42.380244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:42.381777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:42.415302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ab369-5f0f-480d-b28c-179b73ecfb1a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:42.510359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:42.510971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:42.511252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:42.511550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:42.512183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:42.513437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:42.513437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:24:42.513437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:24:42.514666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:42.640891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 744/1498] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:24:42 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:24:42.644867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:42.646614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:42.707596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5ae09-5137-431c-bd73-555ebadf00d3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:42.792879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:42.803263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:42.804034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:42.804359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:42.804641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:42.805287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:42.806298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:42.806298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 18 11:24:42.806298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: Aug 18 11:24:42.807193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:42.820154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 755/1499] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:24:42.824266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:42.825917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:42.837827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab573020-1f6a-4457-9905-ee541da20967 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:42.862326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:42.930669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f86e13-bbc0-4771-a4a2-05c992380413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:42.931201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86e13-bbc0-4771-a4a2-05c992380413 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:42.931480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86e13-bbc0-4771-a4a2-05c992380413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:42.931749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86e13-bbc0-4771-a4a2-05c992380413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:42.932526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f86e13-bbc0-4771-a4a2-05c992380413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:42.933845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-f8f86e13-bbc0-4771-a4a2-05c992380413 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:42.933845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:24:42.933845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:24:42.934793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f86e13-bbc0-4771-a4a2-05c992380413 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:42.947987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 745/1500] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:24:42.953333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:42.954847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:42.988270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf788cc-c31a-4087-923f-17b91aaad18a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:43.085029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5d3f-3fca-4f51-aa21-6abd2d89b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:43.089907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5d3f-3fca-4f51-aa21-6abd2d89b742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:43.089907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5d3f-3fca-4f51-aa21-6abd2d89b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:43.089907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5d3f-3fca-4f51-aa21-6abd2d89b742 admin admin] PATH_INFO: `/v3/projects/9e3e421559674690821ae09334f5248c/users/115d3182ef344f4fa24b086b6d02e7ea/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:43.108112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d5d3f-3fca-4f51-aa21-6abd2d89b742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3e421559674690821ae09334f5248c, user_id=115d3182ef344f4fa24b086b6d02e7ea, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:43.109166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-c31d5d3f-3fca-4f51-aa21-6abd2d89b742 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:43.109166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 18 11:24:43.109166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: Aug 18 11:24:43.111137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d5d3f-3fca-4f51-aa21-6abd2d89b742 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:43.266075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 756/1501] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:24:42 2022] PUT /identity/v3/projects/9e3e421559674690821ae09334f5248c/users/115d3182ef344f4fa24b086b6d02e7ea/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:24:43.278573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b627-a889-4bb6-8248-6565bb965551 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:43.278863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b627-a889-4bb6-8248-6565bb965551 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:43.279147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b627-a889-4bb6-8248-6565bb965551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:43.335127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f352b627-a889-4bb6-8248-6565bb965551 None None] MFA Rules not processed for user `115d3182ef344f4fa24b086b6d02e7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:24:43.336363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f352b627-a889-4bb6-8248-6565bb965551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:43.415032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 746/1502] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:24:43.428716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3e12-6a00-479b-9aa3-b84f7fef762d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:43.429006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3e12-6a00-479b-9aa3-b84f7fef762d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:43.429286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf3e12-6a00-479b-9aa3-b84f7fef762d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:43.430615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 757/1503] 10.222.0.86 () {54 vars in 964 bytes} [Thu Aug 18 11:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:24:43.436113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffd36-9274-4525-9861-41badee3160e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:43.436432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffd36-9274-4525-9861-41badee3160e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:43.436706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffd36-9274-4525-9861-41badee3160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:43.586903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:43.630961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-722ffd36-9274-4525-9861-41badee3160e None None] MFA Rules not processed for user `0bc29638c1994ab09ea1b1f7c7f247ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:24:43.632156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-722ffd36-9274-4525-9861-41badee3160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:43.707376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 747/1504] 10.222.0.86 () {58 vars in 1061 bytes} [Thu Aug 18 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:24:43.715049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf3e12-6a00-479b-9aa3-b84f7fef762d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:43.717275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-83bf3e12-6a00-479b-9aa3-b84f7fef762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:43.767022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:43.819908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf3e12-6a00-479b-9aa3-b84f7fef762d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:43.894341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:43.894868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:43.895157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:43.895688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:43.897386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:43.995303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:43.996787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:44.000612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:44.015355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 758/1505] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:24:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:24:44.060152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c0dd5-b487-4af6-8803-8637d101d7b0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:44.060483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c0dd5-b487-4af6-8803-8637d101d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:44.060939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c0dd5-b487-4af6-8803-8637d101d7b0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:44.062190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 748/1506] 10.222.0.86 () {52 vars in 830 bytes} [Thu Aug 18 11:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:24:44.065745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:44.066951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:44.166870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dd079-1034-4b4f-b986-f320ca994402 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:44.261367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:44.261995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:44.262276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:44.262547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] PATH_INFO: `/v3/users/115d3182ef344f4fa24b086b6d02e7ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:44.275395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=115d3182ef344f4fa24b086b6d02e7ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:44.276468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:44.276468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 18 11:24:44.276468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: Aug 18 11:24:44.277680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:44.287425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:44.541804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115d3182ef344f4fa24b086b6d02e7ea'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:44.548323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115d3182ef344f4fa24b086b6d02e7ea'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:44.566741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115d3182ef344f4fa24b086b6d02e7ea'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:44.567207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115d3182ef344f4fa24b086b6d02e7ea'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:44.658266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115d3182ef344f4fa24b086b6d02e7ea'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:44.678765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 759/1507] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:24:44 2022] DELETE /identity/v3/users/115d3182ef344f4fa24b086b6d02e7ea => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:24:44.683211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:44.683503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:44.683782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:44.741401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:24:44.742637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:44.820759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:44.833082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 749/1508] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:24:44.842747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:44.843957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:44.944407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d194a0-14fa-49bd-ad99-691694feb81a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:45.000058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:45.018856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514da3b-ccad-4438-b5a6-ea1caa1729b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:45.019474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514da3b-ccad-4438-b5a6-ea1caa1729b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:45.019760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514da3b-ccad-4438-b5a6-ea1caa1729b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:45.020118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514da3b-ccad-4438-b5a6-ea1caa1729b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:45.022002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4514da3b-ccad-4438-b5a6-ea1caa1729b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:45.134433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514da3b-ccad-4438-b5a6-ea1caa1729b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:45.135810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514da3b-ccad-4438-b5a6-ea1caa1729b0 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:45.155210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 760/1509] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:24:45.626928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:24:45.628184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:24:45.640954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50633dc2-ec8b-47cb-a6ec-11c623c52342 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:24:45.741317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:24:45.741947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:24:45.742486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:24:45.742486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] PATH_INFO: `/v3/projects/9e3e421559674690821ae09334f5248c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:24:45.753583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3e421559674690821ae09334f5248c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:24:45.754603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:45.754603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:24:45.754603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:24:45.755826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:24:45.865431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3e421559674690821ae09334f5248c', 'request_id': 'req-87a74191-6da1-4875-a6f2-2dd3d32d55c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:45.871356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3e421559674690821ae09334f5248c', 'request_id': 'req-87a74191-6da1-4875-a6f2-2dd3d32d55c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:45.884865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3e421559674690821ae09334f5248c', 'request_id': 'req-87a74191-6da1-4875-a6f2-2dd3d32d55c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:45.980885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] The token cache is being invalidate because project 9e3e421559674690821ae09334f5248c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:24:45.981101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:45.981526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87a74191-6da1-4875-a6f2-2dd3d32d55c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:24:45.983377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 750/1510] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:24:45 2022] DELETE /identity/v3/projects/9e3e421559674690821ae09334f5248c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:24:55.152355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=62 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:55.978898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:32.403991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5fe6-0818-43d8-8e3f-4ecbd472a597 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:32.404661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5fe6-0818-43d8-8e3f-4ecbd472a597 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:32.404661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5fe6-0818-43d8-8e3f-4ecbd472a597 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:32.405934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:32.410738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b44c20-7a4d-4728-9665-7b132261c630 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:32.411174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b44c20-7a4d-4728-9665-7b132261c630 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:32.411277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b44c20-7a4d-4728-9665-7b132261c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:32.494875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e8b44c20-7a4d-4728-9665-7b132261c630 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:32.495982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e8b44c20-7a4d-4728-9665-7b132261c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:32.602036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:32.761196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab5fe6-0818-43d8-8e3f-4ecbd472a597 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:32.763632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f6ab5fe6-0818-43d8-8e3f-4ecbd472a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:32.907175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab5fe6-0818-43d8-8e3f-4ecbd472a597 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:32.914338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74f0ba-db4c-4073-a535-2883760fa510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:32.915105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f0ba-db4c-4073-a535-2883760fa510 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:32.915454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f0ba-db4c-4073-a535-2883760fa510 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:32.915799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f0ba-db4c-4073-a535-2883760fa510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:32.924804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74f0ba-db4c-4073-a535-2883760fa510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:32.926422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74f0ba-db4c-4073-a535-2883760fa510 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:32.936494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 762/1513] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:26:33.779269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad610a33-3d85-4798-953c-ebd508ea9a4c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:33.779857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad610a33-3d85-4798-953c-ebd508ea9a4c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:33.779857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad610a33-3d85-4798-953c-ebd508ea9a4c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:33.781193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:33.785990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6faae9-9867-4e30-ad8f-5871bf9210d9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:33.786414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6faae9-9867-4e30-ad8f-5871bf9210d9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:33.786535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6faae9-9867-4e30-ad8f-5871bf9210d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:33.805828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1f6faae9-9867-4e30-ad8f-5871bf9210d9 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:33.807053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1f6faae9-9867-4e30-ad8f-5871bf9210d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:33.814797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:33.967947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad610a33-3d85-4798-953c-ebd508ea9a4c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:33.983140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad610a33-3d85-4798-953c-ebd508ea9a4c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:33.988532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744f4d1-2e16-4cc8-9ce7-e541132987fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:33.989122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f4d1-2e16-4cc8-9ce7-e541132987fa service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:33.989403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f4d1-2e16-4cc8-9ce7-e541132987fa service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:33.989677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f4d1-2e16-4cc8-9ce7-e541132987fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:33.998172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f4d1-2e16-4cc8-9ce7-e541132987fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:33.999752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f4d1-2e16-4cc8-9ce7-e541132987fa service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:34.009628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 753/1516] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:34.240833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708e53-1a95-4ccd-8cb0-0c64655c681b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:34.241120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708e53-1a95-4ccd-8cb0-0c64655c681b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:34.241409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708e53-1a95-4ccd-8cb0-0c64655c681b None None] PATH_INFO: `/v3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:34.242709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 764/1517] 10.222.0.87 () {54 vars in 925 bytes} [Thu Aug 18 11:26:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:26:34.248990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22f5c2-f4d9-4b98-828e-9f6dd5c2ef41 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:34.249395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22f5c2-f4d9-4b98-828e-9f6dd5c2ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:34.249562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22f5c2-f4d9-4b98-828e-9f6dd5c2ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:34.308859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1b22f5c2-f4d9-4b98-828e-9f6dd5c2ef41 None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:34.309989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1b22f5c2-f4d9-4b98-828e-9f6dd5c2ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:34.328447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:34.384369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 754/1518] 10.222.0.87 () {58 vars in 1015 bytes} [Thu Aug 18 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:43.800717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=56 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:44.019710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7590b1-6c87-4d58-9d32-5cad1fc25dc4 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:44.019911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7590b1-6c87-4d58-9d32-5cad1fc25dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:44.020170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7590b1-6c87-4d58-9d32-5cad1fc25dc4 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:44.021535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 765/1519] 10.222.0.86 () {54 vars in 961 bytes} [Thu Aug 18 11:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:44.027859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305945b-d53a-4524-9e04-d2d212ab1394 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:44.028624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305945b-d53a-4524-9e04-d2d212ab1394 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:44.028624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305945b-d53a-4524-9e04-d2d212ab1394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:44.047827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3305945b-d53a-4524-9e04-d2d212ab1394 None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:44.049210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3305945b-d53a-4524-9e04-d2d212ab1394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:44.058089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 755/1520] 10.222.0.86 () {58 vars in 1058 bytes} [Thu Aug 18 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:44.065813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7590b1-6c87-4d58-9d32-5cad1fc25dc4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:44.080074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7590b1-6c87-4d58-9d32-5cad1fc25dc4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:44.085041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8b9f5-f5e7-434f-8e55-3a74ecb575a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:44.085637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b9f5-f5e7-434f-8e55-3a74ecb575a0 service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:44.085916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b9f5-f5e7-434f-8e55-3a74ecb575a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:44.086188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b9f5-f5e7-434f-8e55-3a74ecb575a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:44.095190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8b9f5-f5e7-434f-8e55-3a74ecb575a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:44.096792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8b9f5-f5e7-434f-8e55-3a74ecb575a0 service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:44.106426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 766/1521] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:45.244823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4962b1-f2dd-41d6-8eda-9356ca988d5c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:45.245368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4962b1-f2dd-41d6-8eda-9356ca988d5c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:45.245564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4962b1-f2dd-41d6-8eda-9356ca988d5c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:45.247370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:26:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:45.252098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983d79-5071-4e82-b992-0ef4d6987994 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:45.252568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983d79-5071-4e82-b992-0ef4d6987994 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:45.252700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983d79-5071-4e82-b992-0ef4d6987994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:45.272472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a7983d79-5071-4e82-b992-0ef4d6987994 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:45.273694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a7983d79-5071-4e82-b992-0ef4d6987994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:45.281499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:45.436406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4962b1-f2dd-41d6-8eda-9356ca988d5c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:45.450950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4962b1-f2dd-41d6-8eda-9356ca988d5c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:45.456566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f9c38-cdf0-4ee2-9077-2cd1a3271d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:45.457168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9c38-cdf0-4ee2-9077-2cd1a3271d50 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:45.457449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9c38-cdf0-4ee2-9077-2cd1a3271d50 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:45.457723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f9c38-cdf0-4ee2-9077-2cd1a3271d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:45.466741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f9c38-cdf0-4ee2-9077-2cd1a3271d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:45.468371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f9c38-cdf0-4ee2-9077-2cd1a3271d50 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:45.479551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 757/1524] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:46.308876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94193-b380-4939-a719-1898d3aa209f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:46.309406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94193-b380-4939-a719-1898d3aa209f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:46.309406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b94193-b380-4939-a719-1898d3aa209f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:46.310920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 11:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:26:46.316045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396974-6e7d-433c-953d-f40d00c8fb1e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:46.316537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396974-6e7d-433c-953d-f40d00c8fb1e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:46.316650 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396974-6e7d-433c-953d-f40d00c8fb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:46.335991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fe396974-6e7d-433c-953d-f40d00c8fb1e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:46.337525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fe396974-6e7d-433c-953d-f40d00c8fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:46.345225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:46.499620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b94193-b380-4939-a719-1898d3aa209f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:46.513958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b94193-b380-4939-a719-1898d3aa209f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:46.519920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef28521-9aa5-4aae-9b72-c43512cacdac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:46.520598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28521-9aa5-4aae-9b72-c43512cacdac service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:46.520878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28521-9aa5-4aae-9b72-c43512cacdac service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:46.521152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28521-9aa5-4aae-9b72-c43512cacdac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:46.530303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef28521-9aa5-4aae-9b72-c43512cacdac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:46.532171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef28521-9aa5-4aae-9b72-c43512cacdac service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:46.543350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 769/1527] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:50.789035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b13b-1956-466c-9b70-8cfaa4cbc9a2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:50.789613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b13b-1956-466c-9b70-8cfaa4cbc9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:50.789613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b13b-1956-466c-9b70-8cfaa4cbc9a2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:50.790900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:50.796112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ae54-ec81-4a8d-83ff-a3078ffe25ee None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:50.796568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ae54-ec81-4a8d-83ff-a3078ffe25ee None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:50.796722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ae54-ec81-4a8d-83ff-a3078ffe25ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:50.815959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4c56ae54-ec81-4a8d-83ff-a3078ffe25ee None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:50.817230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4c56ae54-ec81-4a8d-83ff-a3078ffe25ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:50.825705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:51.119868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b13b-1956-466c-9b70-8cfaa4cbc9a2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:51.121633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eba7b13b-1956-466c-9b70-8cfaa4cbc9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:51.202838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b13b-1956-466c-9b70-8cfaa4cbc9a2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:51.206477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093e7d3-17d4-44e3-b23a-9cc0ad889ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:51.207094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093e7d3-17d4-44e3-b23a-9cc0ad889ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:51.207811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093e7d3-17d4-44e3-b23a-9cc0ad889ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:51.207811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093e7d3-17d4-44e3-b23a-9cc0ad889ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:51.217516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093e7d3-17d4-44e3-b23a-9cc0ad889ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:51.218959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093e7d3-17d4-44e3-b23a-9cc0ad889ce7 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:51.230196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 760/1530] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:53.155230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3ccf-9bcb-48ce-b19d-e0513821b90e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:53.155833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3ccf-9bcb-48ce-b19d-e0513821b90e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:53.155833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3ccf-9bcb-48ce-b19d-e0513821b90e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:53.157172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:53.162251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69118a-2258-409c-8255-5956db4a5b32 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:53.162637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69118a-2258-409c-8255-5956db4a5b32 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:53.162811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69118a-2258-409c-8255-5956db4a5b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:53.183154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fa69118a-2258-409c-8255-5956db4a5b32 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:53.184370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fa69118a-2258-409c-8255-5956db4a5b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:53.192318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:53.487942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3ccf-9bcb-48ce-b19d-e0513821b90e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:53.499358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3ccf-9bcb-48ce-b19d-e0513821b90e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:53.502894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1fb7e-40d3-464f-9aa5-06bb9c3758aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:53.503500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1fb7e-40d3-464f-9aa5-06bb9c3758aa service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:53.503783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1fb7e-40d3-464f-9aa5-06bb9c3758aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:53.504058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1fb7e-40d3-464f-9aa5-06bb9c3758aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:53.514227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1fb7e-40d3-464f-9aa5-06bb9c3758aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:53.515639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1fb7e-40d3-464f-9aa5-06bb9c3758aa service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:53.528812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 772/1533] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:57.258255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1727-32c5-4900-a0d2-084a342981e5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:57.259272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1727-32c5-4900-a0d2-084a342981e5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:57.259272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb1727-32c5-4900-a0d2-084a342981e5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:57.260595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:57.267470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87e3af-188a-4101-a982-cabbf0fdeceb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:57.267940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87e3af-188a-4101-a982-cabbf0fdeceb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:57.268082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87e3af-188a-4101-a982-cabbf0fdeceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:57.287889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8f87e3af-188a-4101-a982-cabbf0fdeceb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:57.289134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8f87e3af-188a-4101-a982-cabbf0fdeceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:57.297623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:26:57.859213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb1727-32c5-4900-a0d2-084a342981e5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:26:57.860909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d5fb1727-32c5-4900-a0d2-084a342981e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:57.928932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:57.942685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb1727-32c5-4900-a0d2-084a342981e5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:26:57.946403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a756bd-b258-44f5-a983-a263f2a68c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:26:57.947008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a756bd-b258-44f5-a983-a263f2a68c0e service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:57.947317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a756bd-b258-44f5-a983-a263f2a68c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:57.947615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a756bd-b258-44f5-a983-a263f2a68c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:57.957516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a756bd-b258-44f5-a983-a263f2a68c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:26:57.958944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a756bd-b258-44f5-a983-a263f2a68c0e service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:26:57.969088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 763/1536] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:59.934937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0eb19-1301-4b00-b69e-9390cb242197 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:59.935478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0eb19-1301-4b00-b69e-9390cb242197 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:59.935478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0eb19-1301-4b00-b69e-9390cb242197 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:59.937000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 11:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:26:59.942231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c1d65-aa15-4d31-80ae-3a64d7c78ef2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:26:59.942616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c1d65-aa15-4d31-80ae-3a64d7c78ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:26:59.942776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c1d65-aa15-4d31-80ae-3a64d7c78ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:26:59.962562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c58c1d65-aa15-4d31-80ae-3a64d7c78ef2 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:26:59.963747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c58c1d65-aa15-4d31-80ae-3a64d7c78ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:26:59.971793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:27:00.532336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0eb19-1301-4b00-b69e-9390cb242197 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:27:00.534067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5eb0eb19-1301-4b00-b69e-9390cb242197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:27:00.547105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0eb19-1301-4b00-b69e-9390cb242197 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:27:00.550600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468b86c-4952-48b2-96bd-6944f32d57aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:27:00.551192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b86c-4952-48b2-96bd-6944f32d57aa service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:27:00.551474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b86c-4952-48b2-96bd-6944f32d57aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:27:00.551749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b86c-4952-48b2-96bd-6944f32d57aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:27:00.560967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468b86c-4952-48b2-96bd-6944f32d57aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:27:00.562479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468b86c-4952-48b2-96bd-6944f32d57aa service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:27:00.572744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 775/1539] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:27:09.957853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=11 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:10.568415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=33 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:35.087281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1deae-b84f-422b-8e2e-1c75534a42ce None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.109462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1deae-b84f-422b-8e2e-1c75534a42ce None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.109462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1deae-b84f-422b-8e2e-1c75534a42ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.120571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-aef1deae-b84f-422b-8e2e-1c75534a42ce None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:35.122382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aef1deae-b84f-422b-8e2e-1c75534a42ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:35.133791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 765/1540] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:35.143813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165a84c-1c37-4a29-ae8e-3d41e6b7fa07 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.144442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165a84c-1c37-4a29-ae8e-3d41e6b7fa07 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.144442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165a84c-1c37-4a29-ae8e-3d41e6b7fa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.169458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3165a84c-1c37-4a29-ae8e-3d41e6b7fa07 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:35.170704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3165a84c-1c37-4a29-ae8e-3d41e6b7fa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:35.184007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 776/1541] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:28:35.189671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1deae-b84f-422b-8e2e-1c75534a42ce None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.210993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1deae-b84f-422b-8e2e-1c75534a42ce None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.221623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.222629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.223137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.223646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.224557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:35.225102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.227106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:35.247917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 766/1542] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:35.256130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165a84c-1c37-4a29-ae8e-3d41e6b7fa07 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.270469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165a84c-1c37-4a29-ae8e-3d41e6b7fa07 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.278010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.278639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.278925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.279192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.279833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.282404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:35.397967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 777/1543] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:35 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:35.402763 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.420169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b85c0-55ea-4d2d-8c1e-668ccf4d6e0e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.491841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680b25-3ee3-482a-a0e9-034a6da75d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.492475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680b25-3ee3-482a-a0e9-034a6da75d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.492758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680b25-3ee3-482a-a0e9-034a6da75d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.493037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680b25-3ee3-482a-a0e9-034a6da75d95 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.493684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680b25-3ee3-482a-a0e9-034a6da75d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.495598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680b25-3ee3-482a-a0e9-034a6da75d95 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:35.614262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 767/1544] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:35 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:35.619689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.630563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297139c-9e4c-4c30-b3bb-a98ec50bc8fa admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.645118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.645889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.646156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.646434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.647099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.647438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ee55-449c-4428-8e18-aa3ef5099030 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.647727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ee55-449c-4428-8e18-aa3ef5099030 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.648051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4ee55-449c-4428-8e18-aa3ef5099030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.648909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:35.673674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 778/1545] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:35.676947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-18b4ee55-449c-4428-8e18-aa3ef5099030 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:35.678208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-18b4ee55-449c-4428-8e18-aa3ef5099030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:35.679121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.690770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 768/1546] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:35.699986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c16ba-b993-46dc-a05b-3ee5fe7885f0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.700343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c16ba-b993-46dc-a05b-3ee5fe7885f0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.700577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c16ba-b993-46dc-a05b-3ee5fe7885f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.702592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce03e2-df87-449f-90df-697176ca7963 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.722068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.722708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.722990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.723266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.723919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.725555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:35.727686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6e3c16ba-b993-46dc-a05b-3ee5fe7885f0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:35.728956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6e3c16ba-b993-46dc-a05b-3ee5fe7885f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:35.744178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 769/1547] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:28:35.752952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c16ba-b993-46dc-a05b-3ee5fe7885f0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.754775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 779/1548] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:28:35.778822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c16ba-b993-46dc-a05b-3ee5fe7885f0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.780010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.788582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.789223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.789509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.789787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.790457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:35.790764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.798549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:35.821975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83d59-56d6-41bf-b0b8-23b601a0e0a2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.836317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 770/1549] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:35.849938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:35.852370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e032c-80e9-4767-804b-16effa12b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.853243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e032c-80e9-4767-804b-16effa12b7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.853536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e032c-80e9-4767-804b-16effa12b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.853821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e032c-80e9-4767-804b-16effa12b7c7 admin admin] PATH_INFO: `/v3/projects/77a95594fdc44d36a9d63d0b74aaccce/users/ea322ee4c163418ebe74f900f35097d8/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.862951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065768-87f9-406f-acce-9c044ab06490 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:35.871418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:35.872051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:35.872363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:35.872643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:35.873284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.874314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:35.874314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:28:35.874314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:28:35.875794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:35.911051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e032c-80e9-4767-804b-16effa12b7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a95594fdc44d36a9d63d0b74aaccce, user_id=ea322ee4c163418ebe74f900f35097d8, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:35.912315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e032c-80e9-4767-804b-16effa12b7c7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.010507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 780/1550] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:35 2022] PUT /identity/v3/projects/77a95594fdc44d36a9d63d0b74aaccce/users/ea322ee4c163418ebe74f900f35097d8/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:36.011959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4af5-4554-410a-b6b9-9b7f381f6245 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.012294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4af5-4554-410a-b6b9-9b7f381f6245 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.012598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4af5-4554-410a-b6b9-9b7f381f6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.015017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 771/1551] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:35 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:36.020188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.048441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e84d4af5-4554-410a-b6b9-9b7f381f6245 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.049821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e84d4af5-4554-410a-b6b9-9b7f381f6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.135045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d391e-aa7b-4c56-8bc2-efd1507a4593 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.146092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa1a06-6252-462e-9b2e-2a78d5cc7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.148059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa1a06-6252-462e-9b2e-2a78d5cc7a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.148371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa1a06-6252-462e-9b2e-2a78d5cc7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.148649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa1a06-6252-462e-9b2e-2a78d5cc7a34 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.149307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa1a06-6252-462e-9b2e-2a78d5cc7a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.152241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa1a06-6252-462e-9b2e-2a78d5cc7a34 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.175982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 781/1552] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.178635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86be8a-d8d7-459c-80f9-362b78cbe48f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.178934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86be8a-d8d7-459c-80f9-362b78cbe48f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.179215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86be8a-d8d7-459c-80f9-362b78cbe48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.232173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-de86be8a-d8d7-459c-80f9-362b78cbe48f None None] MFA Rules not processed for user `ea322ee4c163418ebe74f900f35097d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.233421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-de86be8a-d8d7-459c-80f9-362b78cbe48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.298675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 782/1553] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.299955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438efae6-bf3e-4bba-9e2d-729964270241 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.300273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438efae6-bf3e-4bba-9e2d-729964270241 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.300554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438efae6-bf3e-4bba-9e2d-729964270241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.318168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 772/1554] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:28:36.318304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:36.318409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38063-3613-44c3-bbd6-b6f7bc31645b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.318409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38063-3613-44c3-bbd6-b6f7bc31645b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.318409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38063-3613-44c3-bbd6-b6f7bc31645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.322834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-438efae6-bf3e-4bba-9e2d-729964270241 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.324098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-438efae6-bf3e-4bba-9e2d-729964270241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.334132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 783/1555] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.335447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3495c-09c8-42a6-af36-2149477efef8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.336007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3495c-09c8-42a6-af36-2149477efef8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.336739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3495c-09c8-42a6-af36-2149477efef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.344892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b3f38063-3613-44c3-bbd6-b6f7bc31645b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.346117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b3f38063-3613-44c3-bbd6-b6f7bc31645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.354599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 773/1556] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.355922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface72b-1dcc-4a75-b90b-e116532e5907 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.356238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface72b-1dcc-4a75-b90b-e116532e5907 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.356506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dface72b-1dcc-4a75-b90b-e116532e5907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.366966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:36.367162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0bc3495c-09c8-42a6-af36-2149477efef8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.368399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0bc3495c-09c8-42a6-af36-2149477efef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.377363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 784/1557] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.378651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7e9-83a9-4547-9099-d5849ec7a03b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.378939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7e9-83a9-4547-9099-d5849ec7a03b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.379215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7e9-83a9-4547-9099-d5849ec7a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.382016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dface72b-1dcc-4a75-b90b-e116532e5907 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.383237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dface72b-1dcc-4a75-b90b-e116532e5907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.391981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 774/1558] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.393214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758412e-73d6-406b-aa71-bfbc25239aa4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.393501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758412e-73d6-406b-aa71-bfbc25239aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.393769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758412e-73d6-406b-aa71-bfbc25239aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.399354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c057f7e9-83a9-4547-9099-d5849ec7a03b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.400696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c057f7e9-83a9-4547-9099-d5849ec7a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.409123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 785/1559] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.412559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7e9-83a9-4547-9099-d5849ec7a03b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.416946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e758412e-73d6-406b-aa71-bfbc25239aa4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.418154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e758412e-73d6-406b-aa71-bfbc25239aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.419530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7e9-83a9-4547-9099-d5849ec7a03b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.425076 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031c9c9-668b-438f-873e-3caab384aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.425684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031c9c9-668b-438f-873e-3caab384aeab admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.426050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031c9c9-668b-438f-873e-3caab384aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.426337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031c9c9-668b-438f-873e-3caab384aeab admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.426840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 775/1560] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.427027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031c9c9-668b-438f-873e-3caab384aeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.428775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031c9c9-668b-438f-873e-3caab384aeab admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.429602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb4fb-3803-42e4-b410-3c2f9110a369 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.429893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb4fb-3803-42e4-b410-3c2f9110a369 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.430171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb4fb-3803-42e4-b410-3c2f9110a369 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.431635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 776/1561] 10.222.0.86 () {54 vars in 962 bytes} [Thu Aug 18 11:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:28:36.432724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69bd5-0cb7-4134-a7e9-452a45082581 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.433025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69bd5-0cb7-4134-a7e9-452a45082581 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.433645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d69bd5-0cb7-4134-a7e9-452a45082581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.444306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 786/1562] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:36.455031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e904-5257-4f98-90c7-b24780296f75 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.455031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e904-5257-4f98-90c7-b24780296f75 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.455031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e904-5257-4f98-90c7-b24780296f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.456597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c3d69bd5-0cb7-4134-a7e9-452a45082581 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.457801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c3d69bd5-0cb7-4134-a7e9-452a45082581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.466660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 777/1563] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.467274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d69bd5-0cb7-4134-a7e9-452a45082581 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.471606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6b95e904-5257-4f98-90c7-b24780296f75 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.472924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6b95e904-5257-4f98-90c7-b24780296f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.477892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d69bd5-0cb7-4134-a7e9-452a45082581 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.482227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 787/1564] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.482718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563e0d3-5520-4bec-b692-30c49c72fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.483330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563e0d3-5520-4bec-b692-30c49c72fabc admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.483735 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563e0d3-5520-4bec-b692-30c49c72fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.484112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563e0d3-5520-4bec-b692-30c49c72fabc admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.485472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563e0d3-5520-4bec-b692-30c49c72fabc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:36.485855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563e0d3-5520-4bec-b692-30c49c72fabc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.487606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563e0d3-5520-4bec-b692-30c49c72fabc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.487850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98082ca-434d-4f5e-b263-ead0902f838b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.488136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98082ca-434d-4f5e-b263-ead0902f838b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.488437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98082ca-434d-4f5e-b263-ead0902f838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.499814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 778/1565] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:36.501113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71ea2-b4f0-4b10-97a1-3c07edaf8f1e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.501415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71ea2-b4f0-4b10-97a1-3c07edaf8f1e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.501691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a71ea2-b4f0-4b10-97a1-3c07edaf8f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.511281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f98082ca-434d-4f5e-b263-ead0902f838b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.512556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f98082ca-434d-4f5e-b263-ead0902f838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.521495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 788/1566] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.522192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-82a71ea2-b4f0-4b10-97a1-3c07edaf8f1e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.522545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6e765-f83a-41f9-9574-e5aa96cb17ef None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.522835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6e765-f83a-41f9-9574-e5aa96cb17ef None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.523113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6e765-f83a-41f9-9574-e5aa96cb17ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.523382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-82a71ea2-b4f0-4b10-97a1-3c07edaf8f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.532112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 779/1567] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.533419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a53e-2594-4388-bc27-f7bd2c3b4189 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.533708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a53e-2594-4388-bc27-f7bd2c3b4189 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.533985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a53e-2594-4388-bc27-f7bd2c3b4189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.547843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-59d6e765-f83a-41f9-9574-e5aa96cb17ef None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.549099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-59d6e765-f83a-41f9-9574-e5aa96cb17ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.557069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 789/1568] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.557860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6e765-f83a-41f9-9574-e5aa96cb17ef None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.567190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6e765-f83a-41f9-9574-e5aa96cb17ef None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.571803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.581183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.581910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ddb9a53e-2594-4388-bc27-f7bd2c3b4189 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:36.582022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.582022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.582022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.582289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ddb9a53e-2594-4388-bc27-f7bd2c3b4189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:36.582391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.586643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 790/1569] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:36.587704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.598303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca0c6-f809-4219-b2de-582368ece869 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.604626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.605235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.605611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.605786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.606430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:36.606737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.607736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:36.607736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 18 11:28:36.607736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: Aug 18 11:28:36.608645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.626884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 791/1570] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:36.626884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.632105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e69f-0a50-48b0-a940-ac9a736cde37 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.636740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.641075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.641075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.641075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.641075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:36.641075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.641075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.652350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 780/1571] 10.222.0.86 () {58 vars in 1059 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:36.653207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a53e-2594-4388-bc27-f7bd2c3b4189 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.658404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 792/1572] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:36.659736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.665176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a53e-2594-4388-bc27-f7bd2c3b4189 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.670400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.671014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.671316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.671435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561d45-54d8-479e-82f1-511160613187 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.672194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.672845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.675013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.677433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.677957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.678246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.678525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.679240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:36.679736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.681807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.697393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 793/1573] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:36.698310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.708325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afeb6-6528-4d15-8837-187033973dd1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.712907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.715552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.715552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.715552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.715552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:36.715552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.716588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.729315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 794/1574] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:36.730443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.740839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ec0d-7df6-4e84-bb35-abf265a0d6d5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.745451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.747605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.747605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.747605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.747605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:36.747997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.749379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.761679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 795/1575] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:36.762444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.772810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9710-6aa3-4e52-84f3-8ac772d4c8c0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.778747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 781/1576] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:36.778747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.778947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.778947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.778947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.778947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] PATH_INFO: `/v3/projects/53ff16662af74fbeb2d72efe21c7a9d2/users/79e1333fbbee4656ad73e5b1c3203bd7/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.795499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ff16662af74fbeb2d72efe21c7a9d2, user_id=79e1333fbbee4656ad73e5b1c3203bd7, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.799243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.838722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d4df0-8db7-45ee-a47d-1c4579fe8ca0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.844478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:36.845102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:36.845414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:36.845695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:36.846327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:36.848269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:36.880663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 796/1577] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:36 2022] PUT /identity/v3/projects/53ff16662af74fbeb2d72efe21c7a9d2/users/79e1333fbbee4656ad73e5b1c3203bd7/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:36.881490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.949239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 782/1578] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:36.953844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34850b63-ba7c-4c75-b26b-d826ab8a837f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:36.954259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:36.964465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:37.014484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:37.020281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d81a3c-ff3b-42f1-a739-93fd5ae177f4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.022948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.023567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.023843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.024116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.025257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.025903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.026324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.026628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.027265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.029261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.080876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.082447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.091716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 797/1579] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:37.092626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.103284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aefee3-b405-4905-a4b7-ebd043339e59 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.108027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.108632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.108914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.109426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.110110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.112019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.126409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 783/1580] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:36 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.127362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.190142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c04fe-8eea-49cb-8b8e-8990d6b84f16 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.194959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.195569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.195850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.196128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.196909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.198992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.224255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 798/1581] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.224255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.277147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 784/1582] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.277974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.293046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9ed2-e837-43ce-8b48-895a3dfdf6f7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.328053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:37.347063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9137-bfd6-4063-9515-9d7fd222aa3a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.351938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a7930-22eb-492a-a195-e64528d11c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.352601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7930-22eb-492a-a195-e64528d11c66 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.352892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7930-22eb-492a-a195-e64528d11c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.353207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7930-22eb-492a-a195-e64528d11c66 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.353653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.353849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7930-22eb-492a-a195-e64528d11c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.354411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.354759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.355098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.355790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.355910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7930-22eb-492a-a195-e64528d11c66 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.357871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.466990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 785/1583] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.466990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cda321-73de-4932-aec1-47cc48ebf55c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.466990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cda321-73de-4932-aec1-47cc48ebf55c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.466990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cda321-73de-4932-aec1-47cc48ebf55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.477679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 799/1584] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.478493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.480996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:37.487200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b3cda321-73de-4932-aec1-47cc48ebf55c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:37.488468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b3cda321-73de-4932-aec1-47cc48ebf55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:37.542109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e3f03-330a-49e1-81d5-a43cc69b2a23 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.547748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.548418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.554132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.554132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.554132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.554964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 786/1585] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:37.555063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:37.555063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 18 11:28:37.555063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: Aug 18 11:28:37.555262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cda321-73de-4932-aec1-47cc48ebf55c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.555347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.560742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cda321-73de-4932-aec1-47cc48ebf55c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.565880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.566495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.566781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.567060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.567695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.569701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.671163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 800/1586] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.671163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.680297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d259c-1f2e-42c7-9191-b0d76bf22c7e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.683546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 787/1587] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.683546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.685745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7f181-fded-4253-9af7-e18e5583cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.686353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7f181-fded-4253-9af7-e18e5583cda0 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.686638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7f181-fded-4253-9af7-e18e5583cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.686915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7f181-fded-4253-9af7-e18e5583cda0 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.687612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7f181-fded-4253-9af7-e18e5583cda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.689862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7f181-fded-4253-9af7-e18e5583cda0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.692880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc5070-c829-408c-af06-11f3162b567c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.698184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.698918 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.699205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.699484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.700232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.702252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.801433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 801/1588] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.804360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9cce6-e359-4bff-8ae9-cdd38e6e9274 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.804360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9cce6-e359-4bff-8ae9-cdd38e6e9274 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.804360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9cce6-e359-4bff-8ae9-cdd38e6e9274 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.804881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 802/1589] 10.222.0.86 () {54 vars in 912 bytes} [Thu Aug 18 11:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:28:37.808990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9cce6-e359-4bff-8ae9-cdd38e6e9274 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.821800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9cce6-e359-4bff-8ae9-cdd38e6e9274 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.826284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.826854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.827130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.827474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.828788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.830618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.836397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 788/1590] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.837383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.844927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 803/1591] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:37.845562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.851279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975229b-2829-4b3f-a38f-24a6d40e9b46 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.855979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.856681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.856961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.857236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.857863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.860061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.900116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361adc7-38f6-44e2-8568-b2d40007127e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.904105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.904743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.905030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.913453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.915100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.916575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.926171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 804/1592] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:37.926999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.935919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27b85-0cf4-428b-a711-b63cac4375fd service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.941349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.941945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.942234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.943182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.943182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.944778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.955619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 805/1593] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:37.956447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.966918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08650b12-9f4c-4c12-aa6c-63d6c2f3b044 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.971898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2472fa-38b4-433a-a010-15861cb4faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.972749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2472fa-38b4-433a-a010-15861cb4faa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.973035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2472fa-38b4-433a-a010-15861cb4faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.973437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2472fa-38b4-433a-a010-15861cb4faa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.974094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2472fa-38b4-433a-a010-15861cb4faa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.975708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2472fa-38b4-433a-a010-15861cb4faa7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:37.978320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 789/1594] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:37.979158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:37.986701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 806/1595] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:37.988066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c714c71-f845-4862-a34c-89124828f4ad None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.988381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c714c71-f845-4862-a34c-89124828f4ad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.988661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c714c71-f845-4862-a34c-89124828f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.989868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b508a93-2acd-431f-be80-e9c2c999aea6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:37.994665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:37.995265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:37.995547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:37.995821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:37.996201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:37.996514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:37.998107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.008738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5c714c71-f845-4862-a34c-89124828f4ad None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:38.012411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 790/1596] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.012411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.012667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5c714c71-f845-4862-a34c-89124828f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:38.023164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199d66e-dcf7-4ca8-8200-2a55d47d49a3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.027783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.029240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.029240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.029240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.029621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.031445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.042385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 791/1597] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.043290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.053826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e41d2-8a10-4fab-85d2-cb496d3e39db admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.058723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.059385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.063699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.063699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.063699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.063699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.074096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 792/1598] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.075028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.086434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d82f84-d2df-4a36-85a9-5fd77704c549 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.091102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.091702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.092027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.092324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.093138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.093378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 807/1599] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:28:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:38.094241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c714c71-f845-4862-a34c-89124828f4ad None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.095404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.105722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c714c71-f845-4862-a34c-89124828f4ad None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.108258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 793/1600] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.109693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.114404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.115030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.115317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.116111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.116909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.118995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.120711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04fc6a-0b4e-4579-b4d9-d8c5946cccee admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.127161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.134534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.134534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.134534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.134534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.134534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.134961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 808/1601] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.134961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.143851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 794/1602] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.144323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121a270-115e-47e3-9829-2ee3f34d9d13 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.145521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.150486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.151244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.151534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.151810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.152528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.154254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.159433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ef601-2323-4180-a052-16b475f159a4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.164244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.164852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.165196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.165303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 809/1603] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.166495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.166607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.166694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.169872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.175698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fcb4a-1400-4949-a502-024f67c85273 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.180423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.180906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 795/1604] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.181097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.181347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.181623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] PATH_INFO: `/v3/projects/c2d6454c28f74ff8a3ba13cd03b9af18/users/d1b917bdbd434b538893c060ad44ebd4/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.181741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.192422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5cd4-f38f-4a5e-9320-bdf1f7da0793 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.197230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.197452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6454c28f74ff8a3ba13cd03b9af18, user_id=d1b917bdbd434b538893c060ad44ebd4, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.200772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.200772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.200772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] PATH_INFO: `/v3/projects/9513df8254fd428fb08c7bff40d2125c/users/b6772793f6374d4c8cac164b48ce0efe/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.201064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.214872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9513df8254fd428fb08c7bff40d2125c, user_id=b6772793f6374d4c8cac164b48ce0efe, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.215956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:38.215956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:28:38.215956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:28:38.217903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.338806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 810/1605] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:38 2022] PUT /identity/v3/projects/c2d6454c28f74ff8a3ba13cd03b9af18/users/d1b917bdbd434b538893c060ad44ebd4/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:38.339732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.361607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 796/1606] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:38 2022] PUT /identity/v3/projects/9513df8254fd428fb08c7bff40d2125c/users/b6772793f6374d4c8cac164b48ce0efe/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:38.365007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.412052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:38.431501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208cc8-a5f2-4cfd-bb3d-74980416696f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.459614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e254-aaeb-4f0b-b1df-d4245ea1f7f2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.464420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.465046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.465330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.465606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.466282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.467906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.479052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 797/1607] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:38.485967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.493865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfbd89-d29c-4228-9609-962a1d75975a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.494061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.494531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.494819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.495094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.499052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.500288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.500570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.500845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] PATH_INFO: `/v3/projects/3a52197a56974744843f03235b793110/users/ccf01253b243404e8038acf7884d6ae0/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.521551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:38.527717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a52197a56974744843f03235b793110, user_id=ccf01253b243404e8038acf7884d6ae0, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.528572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.584995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.587333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.599326 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 811/1608] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:38.600162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.611632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbebe6-3a4d-4e00-bcb6-d60d0edb1eab service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.616528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55141d7-085b-4f3c-a1f1-430d1d8ef51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.617263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55141d7-085b-4f3c-a1f1-430d1d8ef51e admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.617547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55141d7-085b-4f3c-a1f1-430d1d8ef51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.617837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55141d7-085b-4f3c-a1f1-430d1d8ef51e admin admin] PATH_INFO: `/v3/projects/60ec2c778f064a6faebbecbcf071f743/users/2e6a7791b6464326a588553b2e6cf715/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.644764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 798/1609] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:38 2022] PUT /identity/v3/projects/3a52197a56974744843f03235b793110/users/ccf01253b243404e8038acf7884d6ae0/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:38.645943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.653446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55141d7-085b-4f3c-a1f1-430d1d8ef51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ec2c778f064a6faebbecbcf071f743, user_id=2e6a7791b6464326a588553b2e6cf715, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.659059 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55141d7-085b-4f3c-a1f1-430d1d8ef51e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.721729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b343-8b39-416a-8409-8ee76fd265f9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.726490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.727158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.727440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.727718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] PATH_INFO: `/v3/projects/1658d7096b154627b53d5fe39911e444/users/41aa8acdf78e4e9eb83430919d4ee9be/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.744062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1658d7096b154627b53d5fe39911e444, user_id=41aa8acdf78e4e9eb83430919d4ee9be, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.746822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:38.751992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 812/1610] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:38 2022] PUT /identity/v3/projects/60ec2c778f064a6faebbecbcf071f743/users/2e6a7791b6464326a588553b2e6cf715/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:38.753616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd702f-2b08-4036-95f3-ee067287c9fc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.753913 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd702f-2b08-4036-95f3-ee067287c9fc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.754245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd702f-2b08-4036-95f3-ee067287c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.774121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-30cd702f-2b08-4036-95f3-ee067287c9fc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:38.775216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-30cd702f-2b08-4036-95f3-ee067287c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:38.847647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 813/1611] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:38.847647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fba00-94a7-4ccc-9ec0-8a7f49787fab None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.847647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fba00-94a7-4ccc-9ec0-8a7f49787fab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.847647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fba00-94a7-4ccc-9ec0-8a7f49787fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.860528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 799/1612] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:38 2022] PUT /identity/v3/projects/1658d7096b154627b53d5fe39911e444/users/41aa8acdf78e4e9eb83430919d4ee9be/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:38.861837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:38.888903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-102fba00-94a7-4ccc-9ec0-8a7f49787fab None None] MFA Rules not processed for user `b6772793f6374d4c8cac164b48ce0efe`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:38.891148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-102fba00-94a7-4ccc-9ec0-8a7f49787fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:38.947755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b80e29-6c95-4614-9e2d-6a9db259800b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:38.954388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dece5-d752-4468-bc66-e21950b9cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:38.955183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dece5-d752-4468-bc66-e21950b9cf88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.955465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dece5-d752-4468-bc66-e21950b9cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.955745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dece5-d752-4468-bc66-e21950b9cf88 admin admin] PATH_INFO: `/v3/projects/5d3a499a551846adbc9081a7a3705b4b/users/7228838e500c4eaa91ddbb45dcecfdf2/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.969961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 814/1613] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:38.973768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:38.975610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:38.975892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:38.980169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dece5-d752-4468-bc66-e21950b9cf88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3a499a551846adbc9081a7a3705b4b, user_id=7228838e500c4eaa91ddbb45dcecfdf2, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:38.985454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dece5-d752-4468-bc66-e21950b9cf88 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.009446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:39.022595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] MFA Rules not processed for user `ccf01253b243404e8038acf7884d6ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:39.023944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:39.072957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 800/1614] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:38 2022] PUT /identity/v3/projects/5d3a499a551846adbc9081a7a3705b4b/users/7228838e500c4eaa91ddbb45dcecfdf2/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:39.074276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba739a-90ff-4e62-ba44-f23c7d7a90e3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.074564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba739a-90ff-4e62-ba44-f23c7d7a90e3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.074841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba739a-90ff-4e62-ba44-f23c7d7a90e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.082945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:39.098813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2bba739a-90ff-4e62-ba44-f23c7d7a90e3 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:39.100112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2bba739a-90ff-4e62-ba44-f23c7d7a90e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:39.121733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 815/1615] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:39.122504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.124191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:39.197304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e7575-141c-4d32-9132-de05ffc95e44 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:39.212397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 801/1616] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:39.214533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4f47-0c20-45a1-93cc-d37cfe54d6b4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.215287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4f47-0c20-45a1-93cc-d37cfe54d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.215561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4f47-0c20-45a1-93cc-d37cfe54d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.245751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-978b4f47-0c20-45a1-93cc-d37cfe54d6b4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:39.246978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-978b4f47-0c20-45a1-93cc-d37cfe54d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:39.255145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 802/1617] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:39.255341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec447-005f-40cf-94e4-e63dd91abaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:39.255576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec447-005f-40cf-94e4-e63dd91abaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.255736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4f47-0c20-45a1-93cc-d37cfe54d6b4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.255957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec447-005f-40cf-94e4-e63dd91abaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.256414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec447-005f-40cf-94e4-e63dd91abaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.268661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec447-005f-40cf-94e4-e63dd91abaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:39.270100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec447-005f-40cf-94e4-e63dd91abaa3 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.280357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 816/1618] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:39.285210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79d3b1-9001-448c-a4a1-f6a82bb0a1a6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.285210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79d3b1-9001-448c-a4a1-f6a82bb0a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.285210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79d3b1-9001-448c-a4a1-f6a82bb0a1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.313781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7e79d3b1-9001-448c-a4a1-f6a82bb0a1a6 None None] MFA Rules not processed for user `7228838e500c4eaa91ddbb45dcecfdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:39.315004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7e79d3b1-9001-448c-a4a1-f6a82bb0a1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:39.329191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4f47-0c20-45a1-93cc-d37cfe54d6b4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:39.333140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:39.333765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.334049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.334327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.372289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:39.393142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 817/1619] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:39.394178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79d3b1-9001-448c-a4a1-f6a82bb0a1a6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.397569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:39.399025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.407047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79d3b1-9001-448c-a4a1-f6a82bb0a1a6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:39.409080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 803/1620] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:39.409932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.414132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:39.415526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.415912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.416702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.417715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:39.419388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4ef93-8f64-4aee-89c9-5a35a1c61e85 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:39.419845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.425008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:39.425859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.426418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.426773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.455367 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:39.456972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.467738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 804/1621] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:39.470378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.479380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5edad1-f447-4eae-a7c8-062f0a591212 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:39.485924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c59250-82cf-45b4-90da-ec189ac1b5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:39.486900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59250-82cf-45b4-90da-ec189ac1b5ac service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.487766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59250-82cf-45b4-90da-ec189ac1b5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.488159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c59250-82cf-45b4-90da-ec189ac1b5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.502342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c59250-82cf-45b4-90da-ec189ac1b5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:39.506453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c59250-82cf-45b4-90da-ec189ac1b5ac service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.518846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 805/1622] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:39.520473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181b9f-c894-485f-886c-f3fc0822b4ab None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.520836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181b9f-c894-485f-886c-f3fc0822b4ab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.521239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181b9f-c894-485f-886c-f3fc0822b4ab None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.523018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 806/1623] 10.222.0.86 () {54 vars in 962 bytes} [Thu Aug 18 11:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:28:39.537371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 818/1624] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:39 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:39.537873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afbd4a-848c-45e8-b201-53a846e65243 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.538356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afbd4a-848c-45e8-b201-53a846e65243 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.538703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afbd4a-848c-45e8-b201-53a846e65243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.541486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.565322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-07afbd4a-848c-45e8-b201-53a846e65243 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:39.569399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-07afbd4a-848c-45e8-b201-53a846e65243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:39.614315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:39.733276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37d47-d652-43bd-8850-cb79b02be93a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:39.743803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:39.744490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.744782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.745113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.747109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:39.750445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.771756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 807/1625] 10.222.0.86 () {58 vars in 1059 bytes} [Thu Aug 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:39.773364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afbd4a-848c-45e8-b201-53a846e65243 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.799031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afbd4a-848c-45e8-b201-53a846e65243 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:39.817500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:39.824573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:39.824573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:39.824573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:39.943394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:39.945093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:39.966358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 819/1626] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:39 2022] POST /identity/v3/users => generated 288 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:28:39.971776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:39.978640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 808/1627] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:39.998704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece4c24-01d6-4849-9c36-09897907a983 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:40.005093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:40.006021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.006634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.007119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.008176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:40.012007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:40.034472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 820/1628] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:28:40.038496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:40.053143 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4eacc4-2b8f-457b-b7e4-aca1748b8e23 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:40.063769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac14b4-4958-49af-b568-6f9d915cd886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:40.067455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac14b4-4958-49af-b568-6f9d915cd886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.067455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac14b4-4958-49af-b568-6f9d915cd886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.067455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac14b4-4958-49af-b568-6f9d915cd886 admin admin] PATH_INFO: `/v3/projects/0d3fc039873d4581880390ee3436b2b4/users/9405b44bf52440b9975cd66892c02b1d/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.102288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac14b4-4958-49af-b568-6f9d915cd886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3fc039873d4581880390ee3436b2b4, user_id=9405b44bf52440b9975cd66892c02b1d, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:40.107875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac14b4-4958-49af-b568-6f9d915cd886 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:40.233678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 809/1629] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:40 2022] PUT /identity/v3/projects/0d3fc039873d4581880390ee3436b2b4/users/9405b44bf52440b9975cd66892c02b1d/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:40.236966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:40.262259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9694-671c-4c9b-8298-bfd31cc53e3f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:40.382806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768130-b429-4066-acd5-3687a10ee1d0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.383092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768130-b429-4066-acd5-3687a10ee1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.391334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768130-b429-4066-acd5-3687a10ee1d0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.391334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 810/1630] 10.222.0.86 () {54 vars in 912 bytes} [Thu Aug 18 11:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:28:40.395853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df928-d052-49ed-ba3a-cf4b272850d4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.396195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df928-d052-49ed-ba3a-cf4b272850d4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.396508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df928-d052-49ed-ba3a-cf4b272850d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.420702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:40.422112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.422892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.422892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.426904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:40.429415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:40.447544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-434df928-d052-49ed-ba3a-cf4b272850d4 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:40.449421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-434df928-d052-49ed-ba3a-cf4b272850d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:40.454839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 821/1631] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:40.454839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:40.465638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abc71c-742e-47be-81bf-ca4260685048 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:40.474433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29642748-e1a6-4d7c-bd7e-7a8cf2a47355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:40.476090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29642748-e1a6-4d7c-bd7e-7a8cf2a47355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.476512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29642748-e1a6-4d7c-bd7e-7a8cf2a47355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.476890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29642748-e1a6-4d7c-bd7e-7a8cf2a47355 admin admin] PATH_INFO: `/v3/projects/0d3fc039873d4581880390ee3436b2b4/users/9405b44bf52440b9975cd66892c02b1d/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.480296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29642748-e1a6-4d7c-bd7e-7a8cf2a47355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3fc039873d4581880390ee3436b2b4, user_id=9405b44bf52440b9975cd66892c02b1d, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:40.485439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29642748-e1a6-4d7c-bd7e-7a8cf2a47355 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:40.516396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 822/1632] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:40 2022] PUT /identity/v3/projects/0d3fc039873d4581880390ee3436b2b4/users/9405b44bf52440b9975cd66892c02b1d/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:40.521319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b124c-d80a-409c-8833-586f90c4d51c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.521621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b124c-d80a-409c-8833-586f90c4d51c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.521900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b124c-d80a-409c-8833-586f90c4d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.566134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-231b124c-d80a-409c-8833-586f90c4d51c None None] MFA Rules not processed for user `9405b44bf52440b9975cd66892c02b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:40.568013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-231b124c-d80a-409c-8833-586f90c4d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:40.606293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 811/1633] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:28:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:28:40.607969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:40.621404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434df928-d052-49ed-ba3a-cf4b272850d4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:40.681846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:40.740195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 823/1634] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:40.779642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434df928-d052-49ed-ba3a-cf4b272850d4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:40.862955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:40.863701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.865553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.865855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.891982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b124c-d80a-409c-8833-586f90c4d51c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:40.910368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b124c-d80a-409c-8833-586f90c4d51c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:40.918956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:40.919761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:40.923082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:40.923082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:40.938533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:40.940756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:40.965565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 824/1635] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:28:40.985435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:40.987070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:41.003509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 812/1636] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:43.230981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:43.326377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:43.390078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7d40-8cff-404c-871e-f8997436eaaa service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:43.397202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:43.398038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:43.398821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:43.398821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] PATH_INFO: `/v3/users/ccf01253b243404e8038acf7884d6ae0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:43.400381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf01253b243404e8038acf7884d6ae0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:43.402403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:43.481878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3815f-9d83-4a4d-a58c-75b5d6d3796b service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:43.491082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:43.492047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:43.492411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:43.492816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] PATH_INFO: `/v3/users/ea322ee4c163418ebe74f900f35097d8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:43.498649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea322ee4c163418ebe74f900f35097d8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:43.499924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:43.499924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 18 11:28:43.499924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: Aug 18 11:28:43.501458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:43.600866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:43.651541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf01253b243404e8038acf7884d6ae0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.652483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf01253b243404e8038acf7884d6ae0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.694358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf01253b243404e8038acf7884d6ae0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.695860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf01253b243404e8038acf7884d6ae0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.801782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-70c2402b-de33-442a-814f-f60cd026f810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf01253b243404e8038acf7884d6ae0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.823159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 825/1637] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:28:43 2022] DELETE /identity/v3/users/ccf01253b243404e8038acf7884d6ae0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:43.828386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:43.828694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:43.828937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:43.855157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea322ee4c163418ebe74f900f35097d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.860604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea322ee4c163418ebe74f900f35097d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.872274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:43.873824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:43.905012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:43.943119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea322ee4c163418ebe74f900f35097d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.970468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea322ee4c163418ebe74f900f35097d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:43.982017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2379b31-680d-4dde-a480-b4e90791212c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea322ee4c163418ebe74f900f35097d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:44.024086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 826/1638] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:44.045099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:44.049439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:44.159517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 813/1639] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:28:43 2022] DELETE /identity/v3/users/ea322ee4c163418ebe74f900f35097d8 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:28:44.162045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:44.162267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:44.162548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:44.206358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:44.207762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:44.209830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24d102-aeaa-4f94-a613-871c52e49f68 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:44.333665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:44.335158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:44.335782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:44.336318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:44.350559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 814/1640] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:28:44.363151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:44.364767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:44.367113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:44.374903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:44.383926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a61cf1-ad54-40da-8153-552c63793fc4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:44.393810 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba2fa8-9346-4c16-b487-461e2ec04522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:44.396614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2fa8-9346-4c16-b487-461e2ec04522 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:44.397021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2fa8-9346-4c16-b487-461e2ec04522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:44.401873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba2fa8-9346-4c16-b487-461e2ec04522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:44.418930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 827/1641] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:44.431636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2fa8-9346-4c16-b487-461e2ec04522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:44.433423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba2fa8-9346-4c16-b487-461e2ec04522 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:44.445691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 815/1642] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:45.858387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:45.866929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:45.912475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32263313-8c4a-4075-9d04-4dd222c4cab0 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:45.919750 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:45.920826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:45.921832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:45.922378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] PATH_INFO: `/v3/projects/77a95594fdc44d36a9d63d0b74aaccce` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:45.923791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a95594fdc44d36a9d63d0b74aaccce)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:45.925270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:45.925270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 18 11:28:45.925270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: Aug 18 11:28:45.927428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:46.215519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a95594fdc44d36a9d63d0b74aaccce', 'request_id': 'req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:46.242426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a95594fdc44d36a9d63d0b74aaccce', 'request_id': 'req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:46.325271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a95594fdc44d36a9d63d0b74aaccce', 'request_id': 'req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:46.377155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] The token cache is being invalidate because project 77a95594fdc44d36a9d63d0b74aaccce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:28:46.379661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:46.382477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:46.391944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 828/1643] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:28:45 2022] DELETE /identity/v3/projects/77a95594fdc44d36a9d63d0b74aaccce => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:46.400041 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a9aad-4c9d-4c55-959d-b29e494c31ec None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:46.400604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a9aad-4c9d-4c55-959d-b29e494c31ec None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:46.400604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a9aad-4c9d-4c55-959d-b29e494c31ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:46.434822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1b9a9aad-4c9d-4c55-959d-b29e494c31ec None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:46.436150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1b9a9aad-4c9d-4c55-959d-b29e494c31ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:46.531873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:46.533622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:46.539451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:46.591197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 816/1644] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:28:46.616525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19f19-f41f-47a0-a773-14808ccb56af None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:46.616861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19f19-f41f-47a0-a773-14808ccb56af None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:46.617277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c19f19-f41f-47a0-a773-14808ccb56af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:46.648416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-94c19f19-f41f-47a0-a773-14808ccb56af None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:46.649825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-94c19f19-f41f-47a0-a773-14808ccb56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:46.671191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 817/1645] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:28:46.672130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c19f19-f41f-47a0-a773-14808ccb56af None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:46.703076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c19f19-f41f-47a0-a773-14808ccb56af None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:46.716938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:46.717591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:46.722071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:46.722071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:46.722071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:46.722071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:46.723909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:46.748331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 818/1646] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:46.753325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:46.768019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ecc05-2797-4f96-bc25-140883b0edb4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:46.775096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:46.777076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:46.780235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:46.780235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:46.780235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:46.785840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:46.801612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:46.803911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e13865-02c5-4a6c-97c6-d4ab1ae54db0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:46.812717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:46.813386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:46.813675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:46.813956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] PATH_INFO: `/v3/projects/3a52197a56974744843f03235b793110` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:46.816985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a52197a56974744843f03235b793110)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:46.820661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:46.939029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 819/1647] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:46 2022] POST /identity/v3/projects => generated 401 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:46.944762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:46.987487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a52197a56974744843f03235b793110', 'request_id': 'req-88ad6592-6203-4c4d-8af2-a8aca301adec'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.003092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a52197a56974744843f03235b793110', 'request_id': 'req-88ad6592-6203-4c4d-8af2-a8aca301adec'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.085593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e45392-bad6-4b7a-b091-8b7f81d29008 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:47.090960 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a52197a56974744843f03235b793110', 'request_id': 'req-88ad6592-6203-4c4d-8af2-a8aca301adec'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.111682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] The token cache is being invalidate because project 3a52197a56974744843f03235b793110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:28:47.115327 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.119289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.126838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 829/1648] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:28:46 2022] DELETE /identity/v3/projects/3a52197a56974744843f03235b793110 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:28:47.132350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:47.138195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:47.204004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:47.206948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:47.207294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:47.207517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:47.208373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:47.210985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:47.315485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad6592-6203-4c4d-8af2-a8aca301adec admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:47.326408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:47.332233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 820/1649] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:46 2022] POST /identity/v3/users => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:28:47.332437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:47.332437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:47.332437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] PATH_INFO: `/v3/users/9405b44bf52440b9975cd66892c02b1d` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:47.333695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:47.334274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9405b44bf52440b9975cd66892c02b1d)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:47.337266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:47.338560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:47.430598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cbcd6-a9b2-4902-a5d2-31aa2219abc7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:47.467141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:47.467792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:47.468115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:47.468437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:47.469782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:47.474896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:47.510665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 821/1650] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:47.522221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:47.551025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cebd8-4fa2-42a5-bcc9-599004b4e28b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:47.560948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:47.564502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:47.564858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:47.565207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:47.570306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:47.573192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:47.605519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 822/1651] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:47.613471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:47.645938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f027e-c944-4b49-b552-daa2d096df43 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:47.654610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9405b44bf52440b9975cd66892c02b1d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.656391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9405b44bf52440b9975cd66892c02b1d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.662137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:47.662833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:47.663120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:47.663375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] PATH_INFO: `/v3/projects/ff6648762f0d43d688360ea7d69e60f4/users/609d3be573334372b9bd14c35dce1a50/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:47.695579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9405b44bf52440b9975cd66892c02b1d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.698497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9405b44bf52440b9975cd66892c02b1d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.710144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6648762f0d43d688360ea7d69e60f4, user_id=609d3be573334372b9bd14c35dce1a50, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:47.720746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:47.789509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9deb32ce-4686-4bc5-b33e-5a233f9ba205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9405b44bf52440b9975cd66892c02b1d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:47.815948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 830/1652] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:28:47 2022] DELETE /identity/v3/users/9405b44bf52440b9975cd66892c02b1d => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:28:47.876599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 823/1653] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:47 2022] PUT /identity/v3/projects/ff6648762f0d43d688360ea7d69e60f4/users/609d3be573334372b9bd14c35dce1a50/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:47.878238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:47.878531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:47.878809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:47.950953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:47.952053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:48.121082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 831/1654] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:48.275907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:48.282321 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:48.451062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf78c-f3d6-4938-8dc0-2ed89d62606b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:48.458710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:48.459620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:48.459823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:48.460111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:48.482922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:48.485951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:48.512176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 824/1655] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:49.225121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:49.226066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:49.252780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1cefb-debe-4d32-9a68-348d27ed90d1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:49.255703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:49.268985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:49.270169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:49.270870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:49.271153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] PATH_INFO: `/v3/users/7228838e500c4eaa91ddbb45dcecfdf2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:49.275302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7228838e500c4eaa91ddbb45dcecfdf2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:49.278443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:49.619983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7228838e500c4eaa91ddbb45dcecfdf2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:49.621268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7228838e500c4eaa91ddbb45dcecfdf2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:49.629129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:49.684920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7228838e500c4eaa91ddbb45dcecfdf2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:49.686134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7228838e500c4eaa91ddbb45dcecfdf2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:49.778688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:49.781726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:49.784041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-400221b2-91e5-4c9d-afa5-183c1e7bc6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7228838e500c4eaa91ddbb45dcecfdf2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:49.826107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13509c-b900-4705-9a87-ded01791602a service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:49.827475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 832/1656] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:28:49 2022] DELETE /identity/v3/users/7228838e500c4eaa91ddbb45dcecfdf2 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:49.832285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:49.832848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:49.833271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:49.852611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:49.854686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:49.854997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:49.855278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] PATH_INFO: `/v3/projects/0d3fc039873d4581880390ee3436b2b4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:49.868072 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3fc039873d4581880390ee3436b2b4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:49.870077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:49.893120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:49.894320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:50.118514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3fc039873d4581880390ee3436b2b4', 'request_id': 'req-99d13157-ac83-420e-85e0-2661cbe1ac43'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:50.126803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 833/1657] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:50.143148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3fc039873d4581880390ee3436b2b4', 'request_id': 'req-99d13157-ac83-420e-85e0-2661cbe1ac43'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:50.162531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:50.164074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:50.169920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3fc039873d4581880390ee3436b2b4', 'request_id': 'req-99d13157-ac83-420e-85e0-2661cbe1ac43'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:50.269000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] The token cache is being invalidate because project 0d3fc039873d4581880390ee3436b2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:28:50.269795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:50.270722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-99d13157-ac83-420e-85e0-2661cbe1ac43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:50.288837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 825/1658] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:28:49 2022] DELETE /identity/v3/projects/0d3fc039873d4581880390ee3436b2b4 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:50.295486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfade22-c99d-4973-9533-069b98ca701c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:50.299981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfade22-c99d-4973-9533-069b98ca701c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:50.301256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfade22-c99d-4973-9533-069b98ca701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:50.330434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a6816-bca6-4ed8-8447-3ed67befdd4e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:50.389250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ebfade22-c99d-4973-9533-069b98ca701c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:50.393765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ebfade22-c99d-4973-9533-069b98ca701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:50.402229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:50.403208 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:50.403635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:50.404117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:50.407291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:50.535720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:50.539684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:50.571191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 826/1659] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:50.572170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 834/1660] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:50.591466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1c8e-5f3e-4364-ac04-e4e363f2aecc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:50.591951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1c8e-5f3e-4364-ac04-e4e363f2aecc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:50.594071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1c8e-5f3e-4364-ac04-e4e363f2aecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:50.630818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2aad1c8e-5f3e-4364-ac04-e4e363f2aecc None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:50.632886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2aad1c8e-5f3e-4364-ac04-e4e363f2aecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:50.658317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 827/1661] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:50.658447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:50.670766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed59c80-7ff8-418f-af69-47346d81495a service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:50.680443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9f347-5a65-482d-a164-2796cb003ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:50.680443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9f347-5a65-482d-a164-2796cb003ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:50.680443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9f347-5a65-482d-a164-2796cb003ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:50.680443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9f347-5a65-482d-a164-2796cb003ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:50.680762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9f347-5a65-482d-a164-2796cb003ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:50.680762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9f347-5a65-482d-a164-2796cb003ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:50.682338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9f347-5a65-482d-a164-2796cb003ff4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:50.696263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 835/1662] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:50.707159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1c8e-5f3e-4364-ac04-e4e363f2aecc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:50.741967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1c8e-5f3e-4364-ac04-e4e363f2aecc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:50.758183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:50.758183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:50.758183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:50.758183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:50.758541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:50.761262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17c39d-144b-402c-8201-05c8c28799f9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:50.761725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17c39d-144b-402c-8201-05c8c28799f9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:50.765505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17c39d-144b-402c-8201-05c8c28799f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:50.765634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:50.822787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bf17c39d-144b-402c-8201-05c8c28799f9 None None] MFA Rules not processed for user `79e1333fbbee4656ad73e5b1c3203bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:50.828850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bf17c39d-144b-402c-8201-05c8c28799f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:50.920518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 828/1663] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:50 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:50.923580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:50.994913 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:51.005290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 836/1664] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:51.018990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:51.019285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:51.019585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:51.065178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:51.085378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] MFA Rules not processed for user `79e1333fbbee4656ad73e5b1c3203bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:51.086645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:51.126918 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f762-8dab-4fb4-839c-718f18e947b9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:51.142645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:51.143288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:51.143575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:51.143852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:51.144530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:51.146554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:51.212248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 837/1665] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:51.239247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:51.242413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:51.253772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 829/1666] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:50 2022] POST /identity/v3/users => generated 282 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:51.258795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:51.281795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cbda2-a47b-42c0-8939-4ff8775ebed8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:51.289419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:51.290060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:51.290342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:51.290618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:51.292686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:51.294479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:51.320840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 830/1667] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:28:51.325593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:51.348570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda058a-e6b6-439b-96d8-df05e34fb7eb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:51.362990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:51.363628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:51.363913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:51.366495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:51.366495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:51.366664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:51.378624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c77eb7-bd6e-4904-8db8-8025c82aed00 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:51.388676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550d604-6fd9-4783-a687-08f6dc879d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:51.390599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550d604-6fd9-4783-a687-08f6dc879d18 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:51.391286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550d604-6fd9-4783-a687-08f6dc879d18 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:51.395318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550d604-6fd9-4783-a687-08f6dc879d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:51.396105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 831/1668] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:51.397621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:51.405920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550d604-6fd9-4783-a687-08f6dc879d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:51.408422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550d604-6fd9-4783-a687-08f6dc879d18 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:51.417531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f43e09-9bd5-4a65-9047-fd3fef1b6f68 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:51.430661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:51.431495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:51.431786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:51.432063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] PATH_INFO: `/v3/projects/1e92f3740de743c1a62138cf0d965b6a/users/28f28ed5d17b4dc184f2b17d5de518c7/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:51.448983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 838/1669] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:51.470381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e92f3740de743c1a62138cf0d965b6a, user_id=28f28ed5d17b4dc184f2b17d5de518c7, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:51.473175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:51.586820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 832/1670] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:51 2022] PUT /identity/v3/projects/1e92f3740de743c1a62138cf0d965b6a/users/28f28ed5d17b4dc184f2b17d5de518c7/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:51.588180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22414-1c76-40ff-adce-1191e46e621e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:51.588609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22414-1c76-40ff-adce-1191e46e621e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:51.588990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22414-1c76-40ff-adce-1191e46e621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:51.677084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-04b22414-1c76-40ff-adce-1191e46e621e None None] MFA Rules not processed for user `28f28ed5d17b4dc184f2b17d5de518c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:51.679915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-04b22414-1c76-40ff-adce-1191e46e621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:51.839950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 839/1671] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:51.840331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:52.035693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc9b6-eac8-43a9-aff4-89412e39bf79 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:52.060260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd5881-2326-42f2-962e-8811383f4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:52.063907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5881-2326-42f2-962e-8811383f4935 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.064233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5881-2326-42f2-962e-8811383f4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.067201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5881-2326-42f2-962e-8811383f4935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.068474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd5881-2326-42f2-962e-8811383f4935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:52.079405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd5881-2326-42f2-962e-8811383f4935 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:52.252814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b22414-1c76-40ff-adce-1191e46e621e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:52.255167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 833/1672] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:51 2022] POST /identity/v3/projects => generated 365 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:52.277357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b22414-1c76-40ff-adce-1191e46e621e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:52.319838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fde4a-af89-4333-b71b-78e2301eb113 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.320136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fde4a-af89-4333-b71b-78e2301eb113 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.320449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fde4a-af89-4333-b71b-78e2301eb113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.408843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b38d8-9f8b-40fe-bab3-4eb81dcbf330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:52.410090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b38d8-9f8b-40fe-bab3-4eb81dcbf330 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.410524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b38d8-9f8b-40fe-bab3-4eb81dcbf330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.410938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b38d8-9f8b-40fe-bab3-4eb81dcbf330 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.411778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b38d8-9f8b-40fe-bab3-4eb81dcbf330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:52.413970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b38d8-9f8b-40fe-bab3-4eb81dcbf330 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:52.415677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-548fde4a-af89-4333-b71b-78e2301eb113 None None] MFA Rules not processed for user `609d3be573334372b9bd14c35dce1a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:52.416949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-548fde4a-af89-4333-b71b-78e2301eb113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:52.530026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 840/1673] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:52 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:52.531776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ed27-b73d-4228-83c7-2c1f16e4f36d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.533833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ed27-b73d-4228-83c7-2c1f16e4f36d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.533833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ed27-b73d-4228-83c7-2c1f16e4f36d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.538405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 841/1674] 10.222.0.86 () {54 vars in 912 bytes} [Thu Aug 18 11:28:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:28:52.539270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ed27-b73d-4228-83c7-2c1f16e4f36d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:52.566938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:52.583046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ed27-b73d-4228-83c7-2c1f16e4f36d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:52.591824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:52.592495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.592923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.593206 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.593876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:52.596020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:52.619864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 834/1675] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:52.621908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466263-737e-411a-814d-e76551da9083 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.622767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466263-737e-411a-814d-e76551da9083 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.623231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466263-737e-411a-814d-e76551da9083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.630052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 842/1676] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:52.631545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:52.637230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:52.672678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:52.679723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff39ae-6328-4414-8b2a-bdc31f554dfd admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:52.695298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:52.698436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.698730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.703367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] PATH_INFO: `/v3/projects/5d3a499a551846adbc9081a7a3705b4b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.708562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3a499a551846adbc9081a7a3705b4b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:52.711508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:52.768155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-01466263-737e-411a-814d-e76551da9083 None None] MFA Rules not processed for user `bfd4d0f2f95b4861888c33b0c66c602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:52.775401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-01466263-737e-411a-814d-e76551da9083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:52.859284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 835/1677] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:28:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:52.859284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466263-737e-411a-814d-e76551da9083 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:52.860598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-01466263-737e-411a-814d-e76551da9083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:52.916145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466263-737e-411a-814d-e76551da9083 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:52.932005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:52.932746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:52.933035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:52.933310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:52.934051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:52.936238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:53.009908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3a499a551846adbc9081a7a3705b4b', 'request_id': 'req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:53.022845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3a499a551846adbc9081a7a3705b4b', 'request_id': 'req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:53.093813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3a499a551846adbc9081a7a3705b4b', 'request_id': 'req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:53.114587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 836/1678] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:52 2022] POST /identity/v3/projects => generated 403 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:53.115340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:53.131687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] The token cache is being invalidate because project 5d3a499a551846adbc9081a7a3705b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:28:53.132039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:53.133882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:53.136336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 843/1679] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:28:52 2022] DELETE /identity/v3/projects/5d3a499a551846adbc9081a7a3705b4b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:53.137173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:53.143341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:53.157297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:53.338295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443a291-02ab-4e03-ae40-46e78870a96f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:53.355903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2bd1e-3283-4665-a3b1-bccbf147bfe9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:53.360060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:53.361077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.361419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.361625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] PATH_INFO: `/v3/projects/92150b48d70b4839bdec0b41eadc6454/users/7c16486135fe46cc8bdf27f224de070c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.442398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92150b48d70b4839bdec0b41eadc6454, user_id=7c16486135fe46cc8bdf27f224de070c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:53.446137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:53.550632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 837/1680] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:53 2022] PUT /identity/v3/projects/92150b48d70b4839bdec0b41eadc6454/users/7c16486135fe46cc8bdf27f224de070c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:53.551493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:53.554240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfa480-3456-4251-9f13-13590a023b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:53.554898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfa480-3456-4251-9f13-13590a023b95 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.555177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfa480-3456-4251-9f13-13590a023b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.555452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfa480-3456-4251-9f13-13590a023b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.557732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:53.560781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c5bfa480-3456-4251-9f13-13590a023b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:53.595016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfa480-3456-4251-9f13-13590a023b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:53.596737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfa480-3456-4251-9f13-13590a023b95 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:53.630002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 844/1681] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:53.636702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.637241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.637684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.701727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:53.703845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:53.716749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:53.755168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766dad-31f1-409f-9b4e-012b2dad0655 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:53.771096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:53.771950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.772276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.772562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.773215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:53.775238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:53.824738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 845/1682] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:53.828987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:53.828987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:53.841527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7953-32bf-433a-a695-d088a86a00ab None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:53.847968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b800435-be03-4b66-baf4-ded85d8114df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:53.849186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800435-be03-4b66-baf4-ded85d8114df admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.851967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800435-be03-4b66-baf4-ded85d8114df admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.851967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b800435-be03-4b66-baf4-ded85d8114df admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.851967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b800435-be03-4b66-baf4-ded85d8114df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:53.852882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b800435-be03-4b66-baf4-ded85d8114df admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:53.865402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 846/1683] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:53.867237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c20c-a8a2-4f3f-bb11-f244eef1671f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.873639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c20c-a8a2-4f3f-bb11-f244eef1671f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.873639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9c20c-a8a2-4f3f-bb11-f244eef1671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.910550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 838/1684] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:53 2022] POST /identity/v3/users => generated 308 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:53.914426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:53.916753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c7e9c20c-a8a2-4f3f-bb11-f244eef1671f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:53.918592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c7e9c20c-a8a2-4f3f-bb11-f244eef1671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:53.932793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:53.934305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 847/1685] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:53.936768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319d4d-e492-45e2-9c4a-0b017456f951 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.937728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118173-11a6-487c-9d55-26a6d2f21bad admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:53.938223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319d4d-e492-45e2-9c4a-0b017456f951 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.938721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43319d4d-e492-45e2-9c4a-0b017456f951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.950246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:53.956435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:53.956435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:53.956435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] PATH_INFO: `/v3/projects/92150b48d70b4839bdec0b41eadc6454/users/7c16486135fe46cc8bdf27f224de070c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:53.957743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92150b48d70b4839bdec0b41eadc6454, user_id=7c16486135fe46cc8bdf27f224de070c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:53.961549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:53.975646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 839/1686] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:53 2022] PUT /identity/v3/projects/92150b48d70b4839bdec0b41eadc6454/users/7c16486135fe46cc8bdf27f224de070c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:53.976857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:53.987868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-43319d4d-e492-45e2-9c4a-0b017456f951 None None] MFA Rules not processed for user `41aa8acdf78e4e9eb83430919d4ee9be`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:53.990909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-43319d4d-e492-45e2-9c4a-0b017456f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:54.115857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 848/1687] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:54.116976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43319d4d-e492-45e2-9c4a-0b017456f951 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:54.163987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad394-75d5-445b-bd99-a467afd20d04 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:54.178648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c36b1-690c-4a59-8c3b-f4dacee64ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:54.179680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c36b1-690c-4a59-8c3b-f4dacee64ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.180158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c36b1-690c-4a59-8c3b-f4dacee64ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.180757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c36b1-690c-4a59-8c3b-f4dacee64ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:54.181790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c36b1-690c-4a59-8c3b-f4dacee64ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:54.183581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c36b1-690c-4a59-8c3b-f4dacee64ed4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:54.229783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 840/1688] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:54.240249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbb4e2-88ce-4df5-ae68-fbe8e5eb6900 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.240249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbb4e2-88ce-4df5-ae68-fbe8e5eb6900 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.240249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbb4e2-88ce-4df5-ae68-fbe8e5eb6900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:54.287769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43319d4d-e492-45e2-9c4a-0b017456f951 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:54.303287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2a362-5662-4e95-842a-fde1daa331b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:54.304951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2a362-5662-4e95-842a-fde1daa331b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.309522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2a362-5662-4e95-842a-fde1daa331b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.310235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2a362-5662-4e95-842a-fde1daa331b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:54.310374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-11fbb4e2-88ce-4df5-ae68-fbe8e5eb6900 None None] MFA Rules not processed for user `7c16486135fe46cc8bdf27f224de070c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:54.311412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2a362-5662-4e95-842a-fde1daa331b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:28:54.312135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-11fbb4e2-88ce-4df5-ae68-fbe8e5eb6900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:54.314172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2a362-5662-4e95-842a-fde1daa331b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:54.319669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2a362-5662-4e95-842a-fde1daa331b5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:54.355339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 849/1689] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:28:54.361370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb214-dfa1-4e54-a551-b874935081d0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.361663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb214-dfa1-4e54-a551-b874935081d0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.363996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb214-dfa1-4e54-a551-b874935081d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:54.417945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-babbb214-dfa1-4e54-a551-b874935081d0 None None] MFA Rules not processed for user `41aa8acdf78e4e9eb83430919d4ee9be`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:54.424500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-babbb214-dfa1-4e54-a551-b874935081d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:54.433382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 850/1690] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:54.434711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb214-dfa1-4e54-a551-b874935081d0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:54.466588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb214-dfa1-4e54-a551-b874935081d0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:54.475225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:54.475934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.476245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.476725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] PATH_INFO: `/v3/projects/a16eda58cf424401860e008b831f9bff/users/275eae98f431436fab06aa77ad1d57be/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:54.520345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16eda58cf424401860e008b831f9bff, user_id=275eae98f431436fab06aa77ad1d57be, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:54.524324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:54.533223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 841/1691] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:54.534017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbb4e2-88ce-4df5-ae68-fbe8e5eb6900 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:54.566694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbb4e2-88ce-4df5-ae68-fbe8e5eb6900 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:54.576335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:54.576335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.576335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.576335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:54.579222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:54.581713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:54.625018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 851/1692] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:54 2022] PUT /identity/v3/projects/a16eda58cf424401860e008b831f9bff/users/275eae98f431436fab06aa77ad1d57be/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:54.626720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:54.629344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:54.705069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 842/1693] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:54 2022] POST /identity/v3/projects => generated 357 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:54.713907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:54.721043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:54.817919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39c27a-2cfa-47ae-8af3-3efb81b1308a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:54.881386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949315-6c34-46dd-b4e8-b9d1bfac44a3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:54.894385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:54.896137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.896137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.896137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:54.987306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14318ae5-0c04-47bf-8161-8492a373193f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:54.989342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318ae5-0c04-47bf-8161-8492a373193f service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:54.989713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318ae5-0c04-47bf-8161-8492a373193f service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:54.990073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318ae5-0c04-47bf-8161-8492a373193f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.043644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:55.049785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:55.051036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:55.091655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 843/1694] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:55.096817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:55.097533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14318ae5-0c04-47bf-8161-8492a373193f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:55.099942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14318ae5-0c04-47bf-8161-8492a373193f service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:55.117387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 852/1695] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:55.141039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc2500-8cdd-4574-bc9f-ff681320f10e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.142577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc2500-8cdd-4574-bc9f-ff681320f10e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.142577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc2500-8cdd-4574-bc9f-ff681320f10e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.143149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 853/1696] 10.222.0.86 () {54 vars in 961 bytes} [Thu Aug 18 11:28:55 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:28:55.143965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc2500-8cdd-4574-bc9f-ff681320f10e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:55.304876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260b907-39a2-44f1-b6c0-70d2113a93da service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:55.360327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305406d-321a-450f-8542-b5d5d1fcb8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:55.361405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305406d-321a-450f-8542-b5d5d1fcb8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.361930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305406d-321a-450f-8542-b5d5d1fcb8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.362433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305406d-321a-450f-8542-b5d5d1fcb8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.364567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305406d-321a-450f-8542-b5d5d1fcb8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:55.367044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305406d-321a-450f-8542-b5d5d1fcb8cb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:55.393177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 844/1697] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:55.416575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb61a9-d41c-40c5-bb36-0accde7a88fd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.416820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb61a9-d41c-40c5-bb36-0accde7a88fd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.417244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb61a9-d41c-40c5-bb36-0accde7a88fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.423500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc2500-8cdd-4574-bc9f-ff681320f10e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:55.455133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:55.455778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.456072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.456381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.457026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:55.471655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-99eb61a9-d41c-40c5-bb36-0accde7a88fd None None] MFA Rules not processed for user `79e1333fbbee4656ad73e5b1c3203bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:55.471655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-99eb61a9-d41c-40c5-bb36-0accde7a88fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:55.475642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:55.554279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:55.563480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 845/1698] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:55.565428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e652b-3d13-4880-832f-01b0f6f2d4a4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.565941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e652b-3d13-4880-832f-01b0f6f2d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.566431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e652b-3d13-4880-832f-01b0f6f2d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.590642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e05e652b-3d13-4880-832f-01b0f6f2d4a4 None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:55.592119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e05e652b-3d13-4880-832f-01b0f6f2d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:55.607144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 854/1699] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:55 2022] POST /identity/v3/users => generated 279 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:55.608882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:55.630188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04610e-8a62-4d0a-ab6f-3e3dc96aa653 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:55.646325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:55.647182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.647494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.647959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] PATH_INFO: `/v3/projects/a16eda58cf424401860e008b831f9bff/users/275eae98f431436fab06aa77ad1d57be/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.655963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16eda58cf424401860e008b831f9bff, user_id=275eae98f431436fab06aa77ad1d57be, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:55.658868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:55.702365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 855/1700] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:55 2022] PUT /identity/v3/projects/a16eda58cf424401860e008b831f9bff/users/275eae98f431436fab06aa77ad1d57be/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:55.702365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:55.789066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 846/1701] 10.222.0.86 () {58 vars in 1058 bytes} [Thu Aug 18 11:28:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:55.789964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e652b-3d13-4880-832f-01b0f6f2d4a4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:55.817624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e652b-3d13-4880-832f-01b0f6f2d4a4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:55.840081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97e620-9a29-493f-ba0c-762b7195f51a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:55.845126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:55.850296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.850296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.850296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.851408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:55.961994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:55.963453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:55.976246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:55.980161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:55.980161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:55.982427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:55.984618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:55.986462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:56.003645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 847/1702] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:56.009098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:56.009098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:56.010884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 856/1703] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:56.011787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:56.024047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1cf27-4716-4238-b06d-4a9f72c7a110 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:56.028951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:56.033696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:56.033696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.033696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.034022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] PATH_INFO: `/v3/users/b6772793f6374d4c8cac164b48ce0efe` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.035348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6772793f6374d4c8cac164b48ce0efe)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:56.037987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:56.201509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fddea-0d30-4d97-988d-38516994131e service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:56.219297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693050-ec57-4048-981a-9b18ecb5733f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:56.219997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693050-ec57-4048-981a-9b18ecb5733f service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.220365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693050-ec57-4048-981a-9b18ecb5733f service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.220839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693050-ec57-4048-981a-9b18ecb5733f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.224326 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-72693050-ec57-4048-981a-9b18ecb5733f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:56.254778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693050-ec57-4048-981a-9b18ecb5733f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:56.260613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693050-ec57-4048-981a-9b18ecb5733f service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:56.284066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 857/1704] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:56.289352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6772793f6374d4c8cac164b48ce0efe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:56.290072 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6772793f6374d4c8cac164b48ce0efe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:56.297983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8686e8-d3ad-4218-9f72-4635c247e53a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.298261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8686e8-d3ad-4218-9f72-4635c247e53a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.303047 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8686e8-d3ad-4218-9f72-4635c247e53a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.308560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 858/1705] 10.222.0.86 () {54 vars in 912 bytes} [Thu Aug 18 11:28:56 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:28:56.309695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8686e8-d3ad-4218-9f72-4635c247e53a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:56.315862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cb8686e8-d3ad-4218-9f72-4635c247e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:56.331096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6772793f6374d4c8cac164b48ce0efe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:56.342433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6772793f6374d4c8cac164b48ce0efe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:56.344013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6772793f6374d4c8cac164b48ce0efe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:56.382670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8686e8-d3ad-4218-9f72-4635c247e53a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:56.387552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:56.398311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a78969-b03f-460c-b876-6f835b480986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:56.399289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78969-b03f-460c-b876-6f835b480986 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.399663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78969-b03f-460c-b876-6f835b480986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.400164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78969-b03f-460c-b876-6f835b480986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.401073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a78969-b03f-460c-b876-6f835b480986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:56.402917 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a78969-b03f-460c-b876-6f835b480986 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:56.433645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 859/1706] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:56.486205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474b262-6fd7-4242-9cd9-c43c718a67cc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.486517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474b262-6fd7-4242-9cd9-c43c718a67cc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.486798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474b262-6fd7-4242-9cd9-c43c718a67cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.487723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 848/1707] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:28:56 2022] DELETE /identity/v3/users/b6772793f6374d4c8cac164b48ce0efe => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:56.492565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:56.537835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f474b262-6fd7-4242-9cd9-c43c718a67cc None None] MFA Rules not processed for user `bfd4d0f2f95b4861888c33b0c66c602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:56.539833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f474b262-6fd7-4242-9cd9-c43c718a67cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:56.741501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 860/1708] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:28:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:56.745247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce339-8d4e-4ce4-9d80-439ef6d2fa7f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.745780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce339-8d4e-4ce4-9d80-439ef6d2fa7f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.746634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce339-8d4e-4ce4-9d80-439ef6d2fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.781112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b37734-c731-4c86-8916-8fbd7cf96b9c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:56.799907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:56.804000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.804000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.804000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] PATH_INFO: `/v3/projects/b40fced598404ee1ab2277acab614101/users/963f05c6bbac4b53897ad4be47e618a2/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.804363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d31ce339-8d4e-4ce4-9d80-439ef6d2fa7f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:56.805495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d31ce339-8d4e-4ce4-9d80-439ef6d2fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:56.837701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 861/1709] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:56.839443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:56.839735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:56.840060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:56.850225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40fced598404ee1ab2277acab614101, user_id=963f05c6bbac4b53897ad4be47e618a2, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:56.854837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:56.896727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] MFA Rules not processed for user `2e6a7791b6464326a588553b2e6cf715`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:56.898191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:56.961423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:56.979577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 849/1710] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:56 2022] PUT /identity/v3/projects/b40fced598404ee1ab2277acab614101/users/963f05c6bbac4b53897ad4be47e618a2/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:56.979577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:56.982455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:57.018131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 862/1711] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:57.019048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:57.022759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:57.068003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7e68e-9606-40a8-8ab1-f9478f8f38ac None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:57.123846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c99d9e-3a97-4798-9a52-aa03e6649881 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:57.130687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:57.131694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:57.132228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:57.132714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:57.177524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:57.267243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcc366-3265-41ec-876d-b107c19314a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:57.273656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc366-3265-41ec-876d-b107c19314a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:57.276386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc366-3265-41ec-876d-b107c19314a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:57.276674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcc366-3265-41ec-876d-b107c19314a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:57.321066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcc366-3265-41ec-876d-b107c19314a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:57.327238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:57.327709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcc366-3265-41ec-876d-b107c19314a7 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:57.327822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:57.338907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 863/1712] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:57.340832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57d71-25a0-451b-8e6e-5534de24f258 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:57.341278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57d71-25a0-451b-8e6e-5534de24f258 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:57.341694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d57d71-25a0-451b-8e6e-5534de24f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:57.374713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 850/1713] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:57.454031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-66d57d71-25a0-451b-8e6e-5534de24f258 None None] MFA Rules not processed for user `963f05c6bbac4b53897ad4be47e618a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:57.456135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-66d57d71-25a0-451b-8e6e-5534de24f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:57.588864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:57.595480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:57.607785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 864/1714] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:57.609352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57d71-25a0-451b-8e6e-5534de24f258 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:57.625687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d57d71-25a0-451b-8e6e-5534de24f258 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:57.640532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:57.641321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:57.641611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:57.641887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:57.642546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:57.650226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:57.802091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d24646-485d-4d68-adbd-136c4ad8d424 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:57.815736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 865/1715] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:28:57 2022] POST /identity/v3/projects => generated 355 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:57.822512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c284b2-9275-46d6-83c9-a670dd4d0de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:57.823162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c284b2-9275-46d6-83c9-a670dd4d0de8 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:57.823451 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c284b2-9275-46d6-83c9-a670dd4d0de8 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:57.823779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c284b2-9275-46d6-83c9-a670dd4d0de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:57.829097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:57.994674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c284b2-9275-46d6-83c9-a670dd4d0de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:57.996510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c284b2-9275-46d6-83c9-a670dd4d0de8 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:58.020679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 851/1716] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:58.022486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586a18f-3060-4dd8-b3cb-127b96a4c9c4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.023087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586a18f-3060-4dd8-b3cb-127b96a4c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.023496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586a18f-3060-4dd8-b3cb-127b96a4c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:58.026298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1034-d648-4f27-85e1-df06aec0ac17 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:58.038130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:58.038772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.039144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.039425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:58.040261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:58.044160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:58.096905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7586a18f-3060-4dd8-b3cb-127b96a4c9c4 None None] MFA Rules not processed for user `d1b917bdbd434b538893c060ad44ebd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:58.098186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7586a18f-3060-4dd8-b3cb-127b96a4c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:58.187339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 866/1717] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:28:57 2022] POST /identity/v3/users => generated 284 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:28:58.191500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:58.201943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:58.219494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56d56f-ea5b-4e7a-8de9-cc90cdc34323 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:58.244344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:58.244344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.244344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.244344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:58.251516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:58.253306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:58.284314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 852/1718] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:58.317641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 867/1719] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:58.319987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586a18f-3060-4dd8-b3cb-127b96a4c9c4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:58.336907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586a18f-3060-4dd8-b3cb-127b96a4c9c4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:58.352850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:58.353656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.355224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.356353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] PATH_INFO: `/v3/projects/40ae01a056854eb59e39c3dd05c20af4/users/934046306a76409fb0d5db00f7491a01/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:58.386118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ae01a056854eb59e39c3dd05c20af4, user_id=934046306a76409fb0d5db00f7491a01, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:58.389742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:58.454441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:58.464363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 853/1720] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:58 2022] PUT /identity/v3/projects/40ae01a056854eb59e39c3dd05c20af4/users/934046306a76409fb0d5db00f7491a01/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:58.465673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:58.485038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65fe1c-b913-440d-b8f7-df20ee4d279e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:58.624759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92b3b-a878-42ba-b72d-5363d7300d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:58.626888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92b3b-a878-42ba-b72d-5363d7300d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.626888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92b3b-a878-42ba-b72d-5363d7300d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.626888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92b3b-a878-42ba-b72d-5363d7300d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:58.628117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92b3b-a878-42ba-b72d-5363d7300d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:58.631381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92b3b-a878-42ba-b72d-5363d7300d7d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:58.654725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 868/1721] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:28:58.659792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:58.684883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718b6d3-19a7-4127-ade9-16dd6649b7a8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:58.691709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:58.692458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.692746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.693544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] PATH_INFO: `/v3/projects/40ae01a056854eb59e39c3dd05c20af4/users/934046306a76409fb0d5db00f7491a01/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:58.695013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ae01a056854eb59e39c3dd05c20af4, user_id=934046306a76409fb0d5db00f7491a01, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:58.697849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:58.732690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.733501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.733794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:58.758784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 854/1722] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:28:58 2022] PUT /identity/v3/projects/40ae01a056854eb59e39c3dd05c20af4/users/934046306a76409fb0d5db00f7491a01/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:28:58.786274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:58.810924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:58.846763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] MFA Rules not processed for user `934046306a76409fb0d5db00f7491a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:58.849998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:58.938337 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881bedb-c228-4ae7-aefd-fbcc0c40aa70 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:58.961121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:58.962215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:58.962384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:58.963476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:59.102229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 869/1723] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:28:59.113707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:59.115203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:59.178257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:59.179939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:59.225548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 855/1724] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:28:59.284889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024847-9d85-4cf9-af8e-03ca47eddba9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:59.299668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52d0d-0ea3-4b1b-aa16-7c3068d9dfd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:59.300428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52d0d-0ea3-4b1b-aa16-7c3068d9dfd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:59.300713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52d0d-0ea3-4b1b-aa16-7c3068d9dfd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:59.300986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52d0d-0ea3-4b1b-aa16-7c3068d9dfd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:59.316393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e52d0d-0ea3-4b1b-aa16-7c3068d9dfd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:59.318386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e52d0d-0ea3-4b1b-aa16-7c3068d9dfd8 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:59.339457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:59.340486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:59.380848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 870/1725] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:28:59.470204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9c1e8-50cd-4726-82f4-40aeb2e7ad93 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:28:59.477437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:28:59.482069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:59.482069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:59.482069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] PATH_INFO: `/v3/projects/9513df8254fd428fb08c7bff40d2125c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:59.485836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9513df8254fd428fb08c7bff40d2125c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:28:59.488282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:28:59.620291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b8e-12ff-4644-a385-6b8ba46cc409 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:28:59.620589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b8e-12ff-4644-a385-6b8ba46cc409 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:28:59.620867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b8e-12ff-4644-a385-6b8ba46cc409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:28:59.659806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9513df8254fd428fb08c7bff40d2125c', 'request_id': 'req-a86e365f-02d4-42ac-a438-cd38064a7ffd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:59.668989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9513df8254fd428fb08c7bff40d2125c', 'request_id': 'req-a86e365f-02d4-42ac-a438-cd38064a7ffd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:59.687714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9513df8254fd428fb08c7bff40d2125c', 'request_id': 'req-a86e365f-02d4-42ac-a438-cd38064a7ffd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:59.720951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-62d05b8e-12ff-4644-a385-6b8ba46cc409 None None] MFA Rules not processed for user `275eae98f431436fab06aa77ad1d57be`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:28:59.722743 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62d05b8e-12ff-4644-a385-6b8ba46cc409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:59.789977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] The token cache is being invalidate because project 9513df8254fd428fb08c7bff40d2125c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:28:59.790980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:59.794288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:28:59.800848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 856/1726] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:28:59 2022] DELETE /identity/v3/projects/9513df8254fd428fb08c7bff40d2125c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:28:59.803635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:28:59.814030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:28:59.878092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:00.014251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e365f-02d4-42ac-a438-cd38064a7ffd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:00.021552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:00.023240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:00.025547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:00.026344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:00.034776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:00.090774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 871/1727] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:28:59 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:00.093372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a32866-bfc8-4b3d-a8e3-3ea27139e19c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:00.100266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a32866-bfc8-4b3d-a8e3-3ea27139e19c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:00.100266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a32866-bfc8-4b3d-a8e3-3ea27139e19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:00.134118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b0a32866-bfc8-4b3d-a8e3-3ea27139e19c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:00.135580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b0a32866-bfc8-4b3d-a8e3-3ea27139e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:00.183232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:00.296001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 872/1728] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:00.312907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdcaa-57da-46c7-b426-37bf41228549 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:00.313791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdcaa-57da-46c7-b426-37bf41228549 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:00.314286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdcaa-57da-46c7-b426-37bf41228549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:00.337179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:00.338645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:00.349649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6cebdcaa-57da-46c7-b426-37bf41228549 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:00.364859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6cebdcaa-57da-46c7-b426-37bf41228549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:00.377461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 857/1729] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:28:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:00.404229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 873/1730] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:00.408060 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:00.427346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fa735-ae49-461f-bbea-6e147d314bbf service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:00.448023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:00.452363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:00.453824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:00.455465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:00.457628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:00.458630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:00.466598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:00.522352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 858/1731] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:00.531656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebdcaa-57da-46c7-b426-37bf41228549 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:00.550154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebdcaa-57da-46c7-b426-37bf41228549 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:00.564084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:00.567401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:00.568111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:00.568677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:00.569527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:00.584657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:00.760003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 874/1732] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:00 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:00.765610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:00.786386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781a0b8-90ec-4b87-b991-325d3dc3e999 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:00.938404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:00.939193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:00.939484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:00.939768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:00.940456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:00.962626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:01.095448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 859/1733] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:00 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:01.100691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:01.117390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470458c8-e883-4543-a99b-3ee28b310951 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:01.120625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:01.126119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:01.127093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:01.127594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:01.128305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:01.129187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:01.131051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:01.147539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 875/1734] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:29:01.151292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:01.188924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871b17b-9ec1-4712-b637-f497a8626e47 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:01.202512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635b754-dac4-40c8-a618-ab4dab01c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:01.203596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635b754-dac4-40c8-a618-ab4dab01c9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:01.205423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635b754-dac4-40c8-a618-ab4dab01c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:01.205929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635b754-dac4-40c8-a618-ab4dab01c9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:01.207961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635b754-dac4-40c8-a618-ab4dab01c9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:01.212091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635b754-dac4-40c8-a618-ab4dab01c9bb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:01.268027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:01.283739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3d58-3749-4f63-b1a6-c3406d2ac9a5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:01.288848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 860/1735] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:01.329475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:01.329475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:01.329475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:01.329475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] PATH_INFO: `/v3/projects/185115746a8a489489fc0e0560ca9144/users/6b8ecbb7dd7149f2b05ec01a5ac39e1b/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:01.392260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185115746a8a489489fc0e0560ca9144, user_id=6b8ecbb7dd7149f2b05ec01a5ac39e1b, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:01.406840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:01.528472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 876/1736] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:01 2022] PUT /identity/v3/projects/185115746a8a489489fc0e0560ca9144/users/6b8ecbb7dd7149f2b05ec01a5ac39e1b/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:01.541329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c84eb-036f-47a7-993d-1da919abe2b9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:01.542680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c84eb-036f-47a7-993d-1da919abe2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:01.543165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c84eb-036f-47a7-993d-1da919abe2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:01.612692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5e0c84eb-036f-47a7-993d-1da919abe2b9 None None] MFA Rules not processed for user `6b8ecbb7dd7149f2b05ec01a5ac39e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:01.614253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e0c84eb-036f-47a7-993d-1da919abe2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:01.756239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 861/1737] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:01.760643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:01.796991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:01.995552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633107b-4f21-4b98-811b-ea60791f8079 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:02.060231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e127ec-02ca-42c9-a20e-f6db714c8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:02.060231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e127ec-02ca-42c9-a20e-f6db714c8b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:02.060231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e127ec-02ca-42c9-a20e-f6db714c8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:02.060231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e127ec-02ca-42c9-a20e-f6db714c8b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:02.072974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e127ec-02ca-42c9-a20e-f6db714c8b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:02.082836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e127ec-02ca-42c9-a20e-f6db714c8b03 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:02.279722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 877/1738] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:01 2022] POST /identity/v3/projects => generated 387 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:02.283617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c84eb-036f-47a7-993d-1da919abe2b9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:02.305901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c84eb-036f-47a7-993d-1da919abe2b9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:02.398565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a9544-8943-4470-aded-1e432a3af5f0 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:02.400545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a9544-8943-4470-aded-1e432a3af5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:02.401055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a9544-8943-4470-aded-1e432a3af5f0 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:02.402752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 878/1739] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:29:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:29:02.510800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:02.512044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:02.513253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:02.513556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:02.514868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:02.529236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:02.586822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc423-9aef-4939-a492-0db202e8ee3c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:02.587187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc423-9aef-4939-a492-0db202e8ee3c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:02.587475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc423-9aef-4939-a492-0db202e8ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:02.645128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-272cc423-9aef-4939-a492-0db202e8ee3c None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:02.647986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-272cc423-9aef-4939-a492-0db202e8ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:02.721920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 862/1740] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:02 2022] POST /identity/v3/users => generated 300 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:02.725863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:02.754985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a714a82-7b2b-4884-85e1-4be7955611f1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:02.770279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:02.770935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:02.771700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:02.771700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:02.772145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:02.781711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:02.843152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 863/1741] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:02.847869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:02.865462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b25f6-76fc-46a7-ad96-97d76136bc70 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:02.882260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:02.887098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:02.888566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:02.888900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] PATH_INFO: `/v3/projects/cdecc143a2d045daada93b6b58784b7e/users/60b1344719f34b3caaf79f14c1bc6ced/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:02.890783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 879/1742] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:29:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:02.916778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5ba9-1db8-4598-bfcb-9d6929a59234 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:02.917058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5ba9-1db8-4598-bfcb-9d6929a59234 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:02.917341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5ba9-1db8-4598-bfcb-9d6929a59234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:02.965222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdecc143a2d045daada93b6b58784b7e, user_id=60b1344719f34b3caaf79f14c1bc6ced, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:02.976823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:03.025825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7acc5ba9-1db8-4598-bfcb-9d6929a59234 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:03.027094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7acc5ba9-1db8-4598-bfcb-9d6929a59234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:03.081597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 864/1743] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:02 2022] PUT /identity/v3/projects/cdecc143a2d045daada93b6b58784b7e/users/60b1344719f34b3caaf79f14c1bc6ced/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:03.082478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:03.088088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:03.274819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 880/1744] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:29:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:03.277075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc5ba9-1db8-4598-bfcb-9d6929a59234 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:03.332034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc5ba9-1db8-4598-bfcb-9d6929a59234 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:03.339499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:03.354754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0df94-edfe-4b19-82cf-4b068ca789e0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:03.375544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:03.378432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:03.378723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:03.379003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:03.412605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:03.416400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:03.467811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 865/1745] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:03.528761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39185fe-05eb-4fdb-8af2-6fd461b4f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:03.530302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39185fe-05eb-4fdb-8af2-6fd461b4f0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:03.530827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39185fe-05eb-4fdb-8af2-6fd461b4f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:03.535651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39185fe-05eb-4fdb-8af2-6fd461b4f0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:03.535651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39185fe-05eb-4fdb-8af2-6fd461b4f0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:03.535651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39185fe-05eb-4fdb-8af2-6fd461b4f0ab admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:03.552256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:03.573850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 881/1746] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:03.581170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec5875-4168-4510-bec2-4c59efdf8039 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:03.598254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:03.599246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:03.600560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:03.601392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] PATH_INFO: `/v3/projects/cdecc143a2d045daada93b6b58784b7e/users/60b1344719f34b3caaf79f14c1bc6ced/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:03.604287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdecc143a2d045daada93b6b58784b7e, user_id=60b1344719f34b3caaf79f14c1bc6ced, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:03.610303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:03.640299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ac91-bcbd-4329-b374-f34c2f1c6b8b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:03.640876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ac91-bcbd-4329-b374-f34c2f1c6b8b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:03.641476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ac91-bcbd-4329-b374-f34c2f1c6b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:03.644675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 866/1747] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:03 2022] PUT /identity/v3/projects/cdecc143a2d045daada93b6b58784b7e/users/60b1344719f34b3caaf79f14c1bc6ced/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:03.673478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:03.705414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a635ac91-bcbd-4329-b374-f34c2f1c6b8b None None] MFA Rules not processed for user `60b1344719f34b3caaf79f14c1bc6ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:03.706707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a635ac91-bcbd-4329-b374-f34c2f1c6b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:03.792106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:03.795028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:03.903375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 882/1748] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:03.927965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ac91-bcbd-4329-b374-f34c2f1c6b8b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:04.159434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ac91-bcbd-4329-b374-f34c2f1c6b8b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:04.172950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:04.174465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:04.174465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:04.174465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:04.174680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c553-04e3-4fa9-9ad2-997f0e3c9819 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:04.193019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6e5eb-ba40-42ef-8122-979f3c518a9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:04.197449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e5eb-ba40-42ef-8122-979f3c518a9e service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:04.197449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e5eb-ba40-42ef-8122-979f3c518a9e service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:04.197449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6e5eb-ba40-42ef-8122-979f3c518a9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:04.200887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:04.207292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:04.249387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 883/1749] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:04.387095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:04.410677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6e5eb-ba40-42ef-8122-979f3c518a9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:04.412443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6e5eb-ba40-42ef-8122-979f3c518a9e service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:04.427444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 867/1750] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:29:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:04.544334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbfe89-308f-42b0-affb-8e5563a10ddf service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:04.555659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:04.557244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:04.557786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:04.558516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] PATH_INFO: `/v3/users/6b8ecbb7dd7149f2b05ec01a5ac39e1b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:04.560672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8ecbb7dd7149f2b05ec01a5ac39e1b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:04.570883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:04.823522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8ecbb7dd7149f2b05ec01a5ac39e1b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:04.826457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8ecbb7dd7149f2b05ec01a5ac39e1b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:04.865531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8ecbb7dd7149f2b05ec01a5ac39e1b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:04.865626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8ecbb7dd7149f2b05ec01a5ac39e1b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:04.948733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:05.013537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8ecbb7dd7149f2b05ec01a5ac39e1b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:05.050723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 884/1751] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:04 2022] DELETE /identity/v3/users/6b8ecbb7dd7149f2b05ec01a5ac39e1b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:05.055657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c182db-d393-487d-a4b3-182d1f35d28f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:05.056668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c182db-d393-487d-a4b3-182d1f35d28f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:05.057269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c182db-d393-487d-a4b3-182d1f35d28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:05.125240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c7c182db-d393-487d-a4b3-182d1f35d28f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:05.140391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c7c182db-d393-487d-a4b3-182d1f35d28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:05.183361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:05.564879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 868/1752] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:05.647124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:05.651978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:05.971517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48364-f233-4669-86b9-f6ac4ccefab0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:05.971517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb8629-6edd-4f31-a6cd-37299eec7807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:05.971517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb8629-6edd-4f31-a6cd-37299eec7807 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:05.971517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb8629-6edd-4f31-a6cd-37299eec7807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:05.972425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb8629-6edd-4f31-a6cd-37299eec7807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:05.972425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb8629-6edd-4f31-a6cd-37299eec7807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:05.972425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb8629-6edd-4f31-a6cd-37299eec7807 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:05.972425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 885/1753] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:06.662512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:06.663435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:06.663435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:06.666169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629c54-1aa4-4025-aba5-375ec4fdb033 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:06.667726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629c54-1aa4-4025-aba5-375ec4fdb033 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:06.668640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629c54-1aa4-4025-aba5-375ec4fdb033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:06.710171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] MFA Rules not processed for user `2e6a7791b6464326a588553b2e6cf715`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:06.713552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:06.749033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-48629c54-1aa4-4025-aba5-375ec4fdb033 None None] MFA Rules not processed for user `bfd4d0f2f95b4861888c33b0c66c602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:06.752729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-48629c54-1aa4-4025-aba5-375ec4fdb033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:06.784578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 869/1754] 10.222.0.87 () {58 vars in 1015 bytes} [Thu Aug 18 11:29:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:06.869521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:06.885436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 886/1755] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:07.182341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629c54-1aa4-4025-aba5-375ec4fdb033 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:07.203259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:07.220963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629c54-1aa4-4025-aba5-375ec4fdb033 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:07.236106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:07.239310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:07.240639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:07.241746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:07.287704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:07.295938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:07.354124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 870/1756] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:08.531250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:08.533538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:08.568710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5372-4e36-4f69-9ae5-168bb3e9e097 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:08.587237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:08.589724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:08.590160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:08.591449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] PATH_INFO: `/v3/users/28f28ed5d17b4dc184f2b17d5de518c7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:08.597677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f28ed5d17b4dc184f2b17d5de518c7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:08.604260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:08.712942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:08.716158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:08.738837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9ec8-c7da-447e-9b07-38cd4f2b9e09 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:08.745971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:08.746999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:08.749181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:08.749887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] PATH_INFO: `/v3/users/609d3be573334372b9bd14c35dce1a50` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:08.751525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] RBAC: Authorizing `identity:delete_user(user_id=609d3be573334372b9bd14c35dce1a50)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:08.754239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:08.972710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f28ed5d17b4dc184f2b17d5de518c7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:08.973632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f28ed5d17b4dc184f2b17d5de518c7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.002628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f28ed5d17b4dc184f2b17d5de518c7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.004270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f28ed5d17b4dc184f2b17d5de518c7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.081299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609d3be573334372b9bd14c35dce1a50'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.087210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609d3be573334372b9bd14c35dce1a50'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.109803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-16948281-e5b6-4a3a-bc43-401a57c87fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f28ed5d17b4dc184f2b17d5de518c7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.126591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609d3be573334372b9bd14c35dce1a50'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.132555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 887/1757] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:08 2022] DELETE /identity/v3/users/28f28ed5d17b4dc184f2b17d5de518c7 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:09.137279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:09.138152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:09.138618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:09.163968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:09.168653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:09.169004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609d3be573334372b9bd14c35dce1a50'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.170970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609d3be573334372b9bd14c35dce1a50'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.313487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 871/1758] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:08 2022] DELETE /identity/v3/users/609d3be573334372b9bd14c35dce1a50 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:09.323187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 888/1759] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:09.333812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:09.335556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:09.460306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:09.461952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:09.585107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405b09b-a162-4dd0-af70-8cca9715907f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:09.592578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:09.597757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:09.597757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:09.597757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] PATH_INFO: `/v3/projects/185115746a8a489489fc0e0560ca9144` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:09.597757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185115746a8a489489fc0e0560ca9144)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:09.615727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:09.632915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e011fa7-5ff9-4108-b747-9ad548edf75f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:09.747077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:09.805506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:09.806142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:09.806421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:09.806699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:09.829215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:09.830688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:09.837601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185115746a8a489489fc0e0560ca9144', 'request_id': 'req-5d4859eb-9b24-4b81-8607-336d47d23554'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.852273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 889/1760] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:09.860395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185115746a8a489489fc0e0560ca9144', 'request_id': 'req-5d4859eb-9b24-4b81-8607-336d47d23554'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.885095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185115746a8a489489fc0e0560ca9144', 'request_id': 'req-5d4859eb-9b24-4b81-8607-336d47d23554'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:09.892676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:10.005928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] The token cache is being invalidate because project 185115746a8a489489fc0e0560ca9144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:10.006239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:10.010262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5d4859eb-9b24-4b81-8607-336d47d23554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:10.012870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 872/1761] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:09 2022] DELETE /identity/v3/projects/185115746a8a489489fc0e0560ca9144 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:10.017574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:10.032148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cd52b-b4dc-4d83-8b65-0b1bec10b8d5 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:10.190938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:10.191754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:10.192051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:10.192364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] PATH_INFO: `/v3/users/60b1344719f34b3caaf79f14c1bc6ced` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:10.193590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b1344719f34b3caaf79f14c1bc6ced)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:10.195588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:10.446967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b1344719f34b3caaf79f14c1bc6ced'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:10.447915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b1344719f34b3caaf79f14c1bc6ced'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:10.481096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b1344719f34b3caaf79f14c1bc6ced'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:10.484996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b1344719f34b3caaf79f14c1bc6ced'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:10.588116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b1344719f34b3caaf79f14c1bc6ced'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:10.605585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 890/1762] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:10 2022] DELETE /identity/v3/users/60b1344719f34b3caaf79f14c1bc6ced => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:11.023603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599db55-a76e-4c40-9d86-c8d154e3ff1a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:11.024182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599db55-a76e-4c40-9d86-c8d154e3ff1a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:11.024182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599db55-a76e-4c40-9d86-c8d154e3ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:11.058639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9599db55-a76e-4c40-9d86-c8d154e3ff1a None None] MFA Rules not processed for user `d1b917bdbd434b538893c060ad44ebd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:11.060202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9599db55-a76e-4c40-9d86-c8d154e3ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:11.253111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 873/1763] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:11.581628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:11.583238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:11.727372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f238ab-9f62-4fe8-9154-f70d80f30944 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:11.733120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:11.734730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:11.737791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:11.739558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] PATH_INFO: `/v3/projects/ff6648762f0d43d688360ea7d69e60f4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:11.743941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6648762f0d43d688360ea7d69e60f4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:11.746147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:11.958635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6648762f0d43d688360ea7d69e60f4', 'request_id': 'req-ab561954-ea0c-4390-93b4-89962c7a3070'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:11.973715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6648762f0d43d688360ea7d69e60f4', 'request_id': 'req-ab561954-ea0c-4390-93b4-89962c7a3070'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.052183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085f2f3-d25e-4a7d-a380-ac0b72ce3e4d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:12.052793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085f2f3-d25e-4a7d-a380-ac0b72ce3e4d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:12.052793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085f2f3-d25e-4a7d-a380-ac0b72ce3e4d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:12.055468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6648762f0d43d688360ea7d69e60f4', 'request_id': 'req-ab561954-ea0c-4390-93b4-89962c7a3070'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.061762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 874/1764] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:29:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:29:12.082826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] The token cache is being invalidate because project ff6648762f0d43d688360ea7d69e60f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:12.084549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.085314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ab561954-ea0c-4390-93b4-89962c7a3070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.088929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 891/1765] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:11 2022] DELETE /identity/v3/projects/ff6648762f0d43d688360ea7d69e60f4 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:12.093421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085f2f3-d25e-4a7d-a380-ac0b72ce3e4d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:12.099863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0085f2f3-d25e-4a7d-a380-ac0b72ce3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:12.102987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f357f-bf9c-4b87-b98c-62a563330336 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:12.104858 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f357f-bf9c-4b87-b98c-62a563330336 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:12.123850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f357f-bf9c-4b87-b98c-62a563330336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:12.174146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-579f357f-bf9c-4b87-b98c-62a563330336 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:12.178589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-579f357f-bf9c-4b87-b98c-62a563330336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:12.308885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 892/1766] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:29:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:12.327455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085f2f3-d25e-4a7d-a380-ac0b72ce3e4d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:12.328921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:12.333054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:12.333751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:12.334033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:12.334483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] PATH_INFO: `/v3/users/275eae98f431436fab06aa77ad1d57be` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:12.336528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275eae98f431436fab06aa77ad1d57be)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:12.339471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:12.618486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290343-8bb3-4aed-9e17-93d41dc1311d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:12.619246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290343-8bb3-4aed-9e17-93d41dc1311d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:12.619629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290343-8bb3-4aed-9e17-93d41dc1311d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:12.622887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 893/1767] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:29:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:29:12.672414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:12.675634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:12.675634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:12.690469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275eae98f431436fab06aa77ad1d57be'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.691800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275eae98f431436fab06aa77ad1d57be'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.701477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:12.703586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:12.718645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 894/1768] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:29:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:12.767330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275eae98f431436fab06aa77ad1d57be'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.777748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275eae98f431436fab06aa77ad1d57be'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.778685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c4abf898-fcc6-4155-a151-f770a48bdad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275eae98f431436fab06aa77ad1d57be'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:12.823160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:12.825552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:12.861699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 875/1769] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:12 2022] DELETE /identity/v3/users/275eae98f431436fab06aa77ad1d57be => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:12.868733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373cfbd-801f-4a82-bea5-f0fb2f22a99f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:13.061999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:13.063795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:13.064656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:13.065230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] PATH_INFO: `/v3/projects/cdecc143a2d045daada93b6b58784b7e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:13.072344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdecc143a2d045daada93b6b58784b7e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:13.074825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:13.206386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdecc143a2d045daada93b6b58784b7e', 'request_id': 'req-8364d614-c276-48ff-b79f-209ec52b008a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:13.212882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdecc143a2d045daada93b6b58784b7e', 'request_id': 'req-8364d614-c276-48ff-b79f-209ec52b008a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:13.279809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdecc143a2d045daada93b6b58784b7e', 'request_id': 'req-8364d614-c276-48ff-b79f-209ec52b008a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:13.299398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] The token cache is being invalidate because project cdecc143a2d045daada93b6b58784b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:13.299788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:13.313596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8364d614-c276-48ff-b79f-209ec52b008a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:13.319418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 895/1770] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:12 2022] DELETE /identity/v3/projects/cdecc143a2d045daada93b6b58784b7e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:13.326921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e821ea-f376-45e7-b04b-686262dcf69b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:13.327741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e821ea-f376-45e7-b04b-686262dcf69b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:13.327741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e821ea-f376-45e7-b04b-686262dcf69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:13.396523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e8e821ea-f376-45e7-b04b-686262dcf69b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:13.399104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e8e821ea-f376-45e7-b04b-686262dcf69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:13.446436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:13.574711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 876/1771] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:13.583145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:13.583759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:13.584277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:13.614305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:13.615867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:13.628508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 896/1772] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:13.632149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e821ea-f376-45e7-b04b-686262dcf69b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:13.644013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e821ea-f376-45e7-b04b-686262dcf69b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:13.650712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:13.652074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:13.652721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:13.653561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:13.656163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:13.657125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:13.660317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:13.683856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:13.686867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:13.738679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1530e1f-f8fe-4d1c-89f4-e25e6e6f1692 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:13.741448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 877/1773] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:13.747059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:13.772223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:13.772223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:13.772223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:13.772223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] PATH_INFO: `/v3/projects/a16eda58cf424401860e008b831f9bff` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:13.777082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16eda58cf424401860e008b831f9bff)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:13.793149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:13.798531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd679b-a409-4301-b36a-0fb7a0f948b0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:13.827557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:13.833996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:13.833996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:13.833996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:13.839288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:13.839288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.006584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16eda58cf424401860e008b831f9bff', 'request_id': 'req-4e555474-2a18-40a5-a440-35cf9b8e3d01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.038592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16eda58cf424401860e008b831f9bff', 'request_id': 'req-4e555474-2a18-40a5-a440-35cf9b8e3d01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.046715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 878/1774] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:13 2022] POST /identity/v3/projects => generated 399 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:14.047611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.057260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.136611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16eda58cf424401860e008b831f9bff', 'request_id': 'req-4e555474-2a18-40a5-a440-35cf9b8e3d01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.158235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] The token cache is being invalidate because project a16eda58cf424401860e008b831f9bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:14.160159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.161402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.168529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 897/1775] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:13 2022] DELETE /identity/v3/projects/a16eda58cf424401860e008b831f9bff => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:14.168529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.171721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.263075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038203f1-d636-4183-bb50-4a7e941e0c02 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.279615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.281069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.281597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.282309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] PATH_INFO: `/v3/projects/1e92f3740de743c1a62138cf0d965b6a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.284336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e92f3740de743c1a62138cf0d965b6a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:14.293017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.353012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e555474-2a18-40a5-a440-35cf9b8e3d01 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.367581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a629a7-aa58-4d97-88a4-d80587fa8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.368942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a629a7-aa58-4d97-88a4-d80587fa8780 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.369520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a629a7-aa58-4d97-88a4-d80587fa8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.372500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a629a7-aa58-4d97-88a4-d80587fa8780 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.374451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a629a7-aa58-4d97-88a4-d80587fa8780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:14.377153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a629a7-aa58-4d97-88a4-d80587fa8780 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.454730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e92f3740de743c1a62138cf0d965b6a', 'request_id': 'req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.458698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e92f3740de743c1a62138cf0d965b6a', 'request_id': 'req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.465501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e92f3740de743c1a62138cf0d965b6a', 'request_id': 'req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.509322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 898/1776] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:14 2022] POST /identity/v3/users => generated 300 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:14.512297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.512297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.512297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.550939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] The token cache is being invalidate because project 1e92f3740de743c1a62138cf0d965b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:14.551233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.552264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:14.557392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 879/1777] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:14 2022] DELETE /identity/v3/projects/1e92f3740de743c1a62138cf0d965b6a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:14.558903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:14.559714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.560148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.562579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.702351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 899/1778] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:14.702351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.702351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.715881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d3c8e-fe90-47cd-ba9c-56ca242b6731 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.718083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870553a-ccc4-4cc8-a5e4-b1f6f85577ea admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.722928 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.723822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.724301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.729685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.729685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:14.729685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.733344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c915b-6685-4ad0-bc43-9a1858fc46ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.734183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c915b-6685-4ad0-bc43-9a1858fc46ff service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.734772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c915b-6685-4ad0-bc43-9a1858fc46ff service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.735144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c915b-6685-4ad0-bc43-9a1858fc46ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.739448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e95c915b-6685-4ad0-bc43-9a1858fc46ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.743682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 900/1779] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:14.744791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.747545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.760597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c915b-6685-4ad0-bc43-9a1858fc46ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:14.761149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c932b-df73-46a9-8adb-fa585e3ce8c3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.765337 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c915b-6685-4ad0-bc43-9a1858fc46ff service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.766457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.767056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.767429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.767639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] PATH_INFO: `/v3/users/7c16486135fe46cc8bdf27f224de070c` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.768815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c16486135fe46cc8bdf27f224de070c)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:14.770794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.789720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 880/1780] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:14.790847 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6d04-aafa-4ca9-90e5-03c9e3863e8b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.791180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6d04-aafa-4ca9-90e5-03c9e3863e8b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.791411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6d04-aafa-4ca9-90e5-03c9e3863e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.831984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a83a6d04-aafa-4ca9-90e5-03c9e3863e8b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:14.833300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a83a6d04-aafa-4ca9-90e5-03c9e3863e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:14.841913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 881/1781] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:14.842733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a6d04-aafa-4ca9-90e5-03c9e3863e8b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.853416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a6d04-aafa-4ca9-90e5-03c9e3863e8b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.859094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.862005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.862005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.862005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.862005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:14.862690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.874506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 882/1782] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:14.876091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.879886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:14.888016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78837aa-3a2e-42e8-be56-4d971b550a33 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.895737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.896404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.896696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.896980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:14.897644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:14.897956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:14.899618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:14.939536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 883/1783] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:14.940635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:14.968369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a32612-4f0a-4086-85fb-09a0ddc0dd94 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:14.974549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:14.975321 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:14.975608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:14.975890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] PATH_INFO: `/v3/projects/e7488f7bccbc48d893105b097bd2fe4b/users/1e53c1e31ddd4c57ac272a0fea0d16b9/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:15.004407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7488f7bccbc48d893105b097bd2fe4b, user_id=1e53c1e31ddd4c57ac272a0fea0d16b9, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:15.008695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:15.030052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c16486135fe46cc8bdf27f224de070c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:15.031263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c16486135fe46cc8bdf27f224de070c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:15.054733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c16486135fe46cc8bdf27f224de070c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:15.055977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c16486135fe46cc8bdf27f224de070c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:15.103333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 884/1784] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:14 2022] PUT /identity/v3/projects/e7488f7bccbc48d893105b097bd2fe4b/users/1e53c1e31ddd4c57ac272a0fea0d16b9/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:15.105671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:15.105671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:15.125839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c16486135fe46cc8bdf27f224de070c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:15.151873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 901/1785] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:14 2022] DELETE /identity/v3/users/7c16486135fe46cc8bdf27f224de070c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:15.152806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:15.167746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:15.307237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36badb7f-721e-4db4-8fd2-80f20561dbb3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:15.316504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39875f-3c87-419f-92fe-79f741ce0fa2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:15.321555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:15.322189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:15.322808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:15.323094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:15.326577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:15.331817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:15.484102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2dbb8-06d6-42a6-bfb2-598a6add6c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:15.485507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2dbb8-06d6-42a6-bfb2-598a6add6c1d service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:15.485971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2dbb8-06d6-42a6-bfb2-598a6add6c1d service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:15.486711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2dbb8-06d6-42a6-bfb2-598a6add6c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:15.489161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-30d2dbb8-06d6-42a6-bfb2-598a6add6c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:15.509239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2dbb8-06d6-42a6-bfb2-598a6add6c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:15.512720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2dbb8-06d6-42a6-bfb2-598a6add6c1d service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:15.543330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 885/1786] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:15.546466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:15.549252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:15.549252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:15.556914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 902/1787] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:15 2022] POST /identity/v3/projects => generated 379 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:15.569107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:15.628099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:15.639683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] MFA Rules not processed for user `1e53c1e31ddd4c57ac272a0fea0d16b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:15.643264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:15.738766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0308a-7aea-4351-8e82-b11ed610643d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:15.756596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:15.757445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:15.757976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:15.758463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:15.759944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:15.762220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:15.877745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 886/1788] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:15.882485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:15.898347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:15.910372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 903/1789] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:15 2022] POST /identity/v3/users => generated 290 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:15.913304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:15.915836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa60bd-1460-44d8-80d3-aab56525246c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:15.922365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:15.923268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:15.923551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:15.923826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:15.925217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:15.927803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:15.967516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5273ef-5951-4ffd-bc2f-b3723452a9ea admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:16.017718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:16.018399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.018979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.018979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.019564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:16.037088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:16.055511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 887/1790] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:15 2022] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:16.062112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:16.106778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 904/1791] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:16.108741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:16.159988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f83dc-90a7-455b-8bb5-67a8fc8325a1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:16.253853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2045cc-3990-4d91-bd21-cd43256c45c7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:16.261018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:16.262057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.262805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.263195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.267178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:16.271455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:16.349053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:16.349686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.349976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.350256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.351013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:16.353295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:16.369624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 905/1792] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:16.370572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:16.389815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8baf39-b508-4ef1-aeef-e0e851f91ac2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:16.395038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc21d-7fed-4a2a-9464-2e79080a5b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:16.395795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc21d-7fed-4a2a-9464-2e79080a5b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.396083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc21d-7fed-4a2a-9464-2e79080a5b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.396558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc21d-7fed-4a2a-9464-2e79080a5b93 admin admin] PATH_INFO: `/v3/projects/bd26c9d8c5564cf78cd23077de968813/users/370586be9a27491c969d2dbc7e812068/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.419724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc21d-7fed-4a2a-9464-2e79080a5b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd26c9d8c5564cf78cd23077de968813, user_id=370586be9a27491c969d2dbc7e812068, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:16.423899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc21d-7fed-4a2a-9464-2e79080a5b93 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:16.440083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 888/1793] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:16 2022] POST /identity/v3/users => generated 306 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:16.442445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:16.462872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5410405-a73f-4887-8a3f-23e64a3d671c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:16.471595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:16.473225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.473612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.473972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.474887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:16.479058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:16.496639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 889/1794] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:16.499280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:16.526982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 906/1795] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:16 2022] PUT /identity/v3/projects/bd26c9d8c5564cf78cd23077de968813/users/370586be9a27491c969d2dbc7e812068/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:16.532563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5c5ce-6a36-4eed-ba23-0201ef45a2e4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:16.546607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3e7f-ad68-4a6f-a633-ff227fdd97c8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.547879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3e7f-ad68-4a6f-a633-ff227fdd97c8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.548305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d3e7f-ad68-4a6f-a633-ff227fdd97c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.584505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9b3d3e7f-ad68-4a6f-a633-ff227fdd97c8 None None] MFA Rules not processed for user `370586be9a27491c969d2dbc7e812068`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:16.599994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9b3d3e7f-ad68-4a6f-a633-ff227fdd97c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:16.791450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:16.794524 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.797389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.803295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] PATH_INFO: `/v3/projects/8856bbd007154387b3eb022104e630ab/users/fb93f4efb4a048eea65505fbd5cbca7b/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.822673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8856bbd007154387b3eb022104e630ab, user_id=fb93f4efb4a048eea65505fbd5cbca7b, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:16.825464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:16.827282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:16.843751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 907/1796] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:16.848355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d3e7f-ad68-4a6f-a633-ff227fdd97c8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:16.874489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d3e7f-ad68-4a6f-a633-ff227fdd97c8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:16.893403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:16.893971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:16.894267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:16.894540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:16.895504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:16.897177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:16.924242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 890/1797] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:16 2022] PUT /identity/v3/projects/8856bbd007154387b3eb022104e630ab/users/fb93f4efb4a048eea65505fbd5cbca7b/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:16.925988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.070839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 908/1798] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:16 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:17.071936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.119059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa215c9-5d8c-45de-abda-ec8b9fe51a59 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:17.192717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d13b9-45c8-40c6-96ae-7fdbb5ce3ea6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:17.208878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:17.208878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.211356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.211356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.212016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:17.218801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:17.282113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:17.283426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.283956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.285183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.286085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:17.287769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:17.306380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 891/1799] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:17.308110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.310027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:17.313388 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 909/1800] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:17 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:17.313733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.325495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee608b-ccb2-47ea-8139-c2fafc771761 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:17.329900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0dae-4c45-4a3f-80a1-eb66b9d778a5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:17.332808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:17.336332 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.336332 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.336332 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] PATH_INFO: `/v3/projects/92150b48d70b4839bdec0b41eadc6454` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.336332 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92150b48d70b4839bdec0b41eadc6454)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:17.336614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:17.336614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.336614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.336614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] PATH_INFO: `/v3/projects/8856bbd007154387b3eb022104e630ab/users/fb93f4efb4a048eea65505fbd5cbca7b/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.338764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8856bbd007154387b3eb022104e630ab, user_id=fb93f4efb4a048eea65505fbd5cbca7b, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:17.338955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:17.343861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:17.364803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 910/1801] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:17 2022] PUT /identity/v3/projects/8856bbd007154387b3eb022104e630ab/users/fb93f4efb4a048eea65505fbd5cbca7b/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:17.366869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.411958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:17.481033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246841d-29db-4ab0-9764-f371d6c00899 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:17.486194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf686fdf-41dd-4b1a-bf07-6019690fbb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:17.486824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf686fdf-41dd-4b1a-bf07-6019690fbb15 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.487182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf686fdf-41dd-4b1a-bf07-6019690fbb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.487380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf686fdf-41dd-4b1a-bf07-6019690fbb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.488193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf686fdf-41dd-4b1a-bf07-6019690fbb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:17.490351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf686fdf-41dd-4b1a-bf07-6019690fbb15 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:17.506204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 911/1802] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:17.507644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95099049-564f-4e49-a178-7bda4c3539b8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.507941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95099049-564f-4e49-a178-7bda4c3539b8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.508459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95099049-564f-4e49-a178-7bda4c3539b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.525926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92150b48d70b4839bdec0b41eadc6454', 'request_id': 'req-69222f4c-9158-4ce6-b08a-e387ed367941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:17.543023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-95099049-564f-4e49-a178-7bda4c3539b8 None None] MFA Rules not processed for user `fb93f4efb4a048eea65505fbd5cbca7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:17.544325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-95099049-564f-4e49-a178-7bda4c3539b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:17.544431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92150b48d70b4839bdec0b41eadc6454', 'request_id': 'req-69222f4c-9158-4ce6-b08a-e387ed367941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:17.555873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92150b48d70b4839bdec0b41eadc6454', 'request_id': 'req-69222f4c-9158-4ce6-b08a-e387ed367941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:17.628975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 912/1803] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:17 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:17.628975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95099049-564f-4e49-a178-7bda4c3539b8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.652897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] The token cache is being invalidate because project 92150b48d70b4839bdec0b41eadc6454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:17.653200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:17.653972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:17.660743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 892/1804] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:17 2022] DELETE /identity/v3/projects/92150b48d70b4839bdec0b41eadc6454 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:17.661689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.663172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:17.752305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95099049-564f-4e49-a178-7bda4c3539b8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:17.777651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222f4c-9158-4ce6-b08a-e387ed367941 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:17.778512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:17.779508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.779850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.780133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] PATH_INFO: `/v3/projects/6cd8c925a4244bf28aa5906db56bd661/users/949c50fc2b244e70b7d8fc3ac59d2095/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.798508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950a505-2353-4dfc-be84-8369d5e53877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:17.800773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950a505-2353-4dfc-be84-8369d5e53877 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.806551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950a505-2353-4dfc-be84-8369d5e53877 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.806551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950a505-2353-4dfc-be84-8369d5e53877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.806551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e950a505-2353-4dfc-be84-8369d5e53877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:17.832462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950a505-2353-4dfc-be84-8369d5e53877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:17.834179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950a505-2353-4dfc-be84-8369d5e53877 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:17.837440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd8c925a4244bf28aa5906db56bd661, user_id=949c50fc2b244e70b7d8fc3ac59d2095, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:17.849665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:17.893604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 893/1805] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:17 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:17.897886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c02e-1af0-438e-a4b8-c84300654eb0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:17.899178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c02e-1af0-438e-a4b8-c84300654eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:17.899464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c02e-1af0-438e-a4b8-c84300654eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:17.908700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:17.957805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-87a9c02e-1af0-438e-a4b8-c84300654eb0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:17.980530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 913/1806] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:17 2022] PUT /identity/v3/projects/6cd8c925a4244bf28aa5906db56bd661/users/949c50fc2b244e70b7d8fc3ac59d2095/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:17.980530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:17.981203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87a9c02e-1af0-438e-a4b8-c84300654eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:17.985192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:18.054034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:18.113011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 894/1807] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:18.130084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd44b-b159-4248-98cc-50003ba3b03a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:18.132273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd44b-b159-4248-98cc-50003ba3b03a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:18.133808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd44b-b159-4248-98cc-50003ba3b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:18.214901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4c3dd44b-b159-4248-98cc-50003ba3b03a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:18.222725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c3dd44b-b159-4248-98cc-50003ba3b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:18.247012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d939e-78e1-42a9-9630-fd62ab543568 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:18.257252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:18.261831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:18.264228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 895/1808] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:18.264348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:18.264348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:18.264526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd44b-b159-4248-98cc-50003ba3b03a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:18.264613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:18.264613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:18.280025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 914/1809] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:18.281189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:18.302537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83c1a8-7148-4912-9ddb-f9f3f53b5cb5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:18.319021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:18.320315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:18.320823 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:18.321348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:18.322998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:18.323317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:18.325991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:18.343745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 915/1810] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:18.344773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:18.398539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec689-8b9d-4c2f-9a12-45ff28d486ca admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:18.412451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:18.413493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd44b-b159-4248-98cc-50003ba3b03a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:18.415430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:18.415723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:18.417125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] PATH_INFO: `/v3/projects/6cd8c925a4244bf28aa5906db56bd661/users/949c50fc2b244e70b7d8fc3ac59d2095/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:18.424953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd8c925a4244bf28aa5906db56bd661, user_id=949c50fc2b244e70b7d8fc3ac59d2095, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:18.425204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a4a29-ad45-4458-b7c6-3ee30de44af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:18.425438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4a29-ad45-4458-b7c6-3ee30de44af9 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:18.428365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4a29-ad45-4458-b7c6-3ee30de44af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:18.428878 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a4a29-ad45-4458-b7c6-3ee30de44af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:18.432621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:18.438865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-201a4a29-ad45-4458-b7c6-3ee30de44af9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:18.477248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 916/1811] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:18 2022] PUT /identity/v3/projects/6cd8c925a4244bf28aa5906db56bd661/users/949c50fc2b244e70b7d8fc3ac59d2095/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:18.477248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:18.548926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a4a29-ad45-4458-b7c6-3ee30de44af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:18.550504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a4a29-ad45-4458-b7c6-3ee30de44af9 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:18.570460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 896/1812] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:18.571919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5e3f-920d-4a50-b71a-6e5fa770f938 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:18.572623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5e3f-920d-4a50-b71a-6e5fa770f938 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:18.572908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5e3f-920d-4a50-b71a-6e5fa770f938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:18.575158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca35b1-9e95-48bd-a073-68d0dd1eef77 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:18.581046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:18.581894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:18.582311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:18.582654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:18.583458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:18.585612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:18.645848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-37db5e3f-920d-4a50-b71a-6e5fa770f938 None None] MFA Rules not processed for user `949c50fc2b244e70b7d8fc3ac59d2095`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:18.645848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-37db5e3f-920d-4a50-b71a-6e5fa770f938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:18.757733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 897/1813] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:18.970339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 917/1814] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:18 2022] POST /identity/v3/projects => generated 377 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:18.975347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db5e3f-920d-4a50-b71a-6e5fa770f938 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:18.986966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db5e3f-920d-4a50-b71a-6e5fa770f938 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.049465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.054175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.054175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.054175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.054175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.054175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.145637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 898/1815] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:18 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:19.146874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.167459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2462b53-56a5-4e41-810f-5cba518640ea admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.174000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.174763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.175231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.175574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.176492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.181669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.191775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 918/1816] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:19.196093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.207938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311d9cc-fb67-4036-be16-4147360f5593 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.216348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.216348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.216348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.216348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.217311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.218427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.230586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 899/1817] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:19.235228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.245717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3662a-b643-40f9-9d3f-391564db72be admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.251982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a863cb-91d6-49e1-aad9-60e26cbaa4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.252707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a863cb-91d6-49e1-aad9-60e26cbaa4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.252994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a863cb-91d6-49e1-aad9-60e26cbaa4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.253276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a863cb-91d6-49e1-aad9-60e26cbaa4f6 admin admin] PATH_INFO: `/v3/projects/4c3c4e4ff587452a8feb793bdd2b5362/users/2cda595e84f04769a1f996bb92eea468/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.274176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a863cb-91d6-49e1-aad9-60e26cbaa4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3c4e4ff587452a8feb793bdd2b5362, user_id=2cda595e84f04769a1f996bb92eea468, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.276871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a863cb-91d6-49e1-aad9-60e26cbaa4f6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.295455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.295455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:19.388098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 919/1818] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:19 2022] PUT /identity/v3/projects/4c3c4e4ff587452a8feb793bdd2b5362/users/2cda595e84f04769a1f996bb92eea468/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:19.392494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53ae6f-686a-4ed9-b600-57215997dce3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.392993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed15e1-6a4f-43eb-bdc9-2ee5f341275d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.393289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed15e1-6a4f-43eb-bdc9-2ee5f341275d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.393572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed15e1-6a4f-43eb-bdc9-2ee5f341275d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.439890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a8ed15e1-6a4f-43eb-bdc9-2ee5f341275d None None] MFA Rules not processed for user `2cda595e84f04769a1f996bb92eea468`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:19.441208 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a8ed15e1-6a4f-43eb-bdc9-2ee5f341275d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:19.458656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.459438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.459792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.460147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.520553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 920/1819] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:19.521772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed15e1-6a4f-43eb-bdc9-2ee5f341275d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.563351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.565284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.579802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 900/1820] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:19.620469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed15e1-6a4f-43eb-bdc9-2ee5f341275d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.626950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.627605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.627890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.628320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.628830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.630976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.737105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.738423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 921/1821] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:19 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:19.756635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58311-560c-4909-96d6-566c9303d495 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.759002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:19.840829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.841490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.841779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.842052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.842771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.844764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.854631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.903031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:19.916216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4adc1e-ed24-4a06-bd83-379991771591 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.921094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.921820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.922168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.922553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.924466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:19.944124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 901/1822] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:19 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:19.948298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.958685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40741164-0dff-4cd5-aa81-8a492e36521e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:19.966001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:19.967380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:19.967707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:19.967986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:19.968679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:19.970279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:19.980599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 902/1823] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:19.986562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:19.996157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b98a16-6154-4b7d-9764-42a72854825b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:20.001716 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:20.002371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:20.002658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:20.002939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] PATH_INFO: `/v3/projects/b95e61f487394f089b5fb3ed1bd7e8cd/users/be2268ddebe14724987476b6a7dfe042/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:20.007683 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:20.009163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:20.018768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95e61f487394f089b5fb3ed1bd7e8cd, user_id=be2268ddebe14724987476b6a7dfe042, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:20.019477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 922/1824] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:20.021507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:20.099263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 903/1825] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:19 2022] PUT /identity/v3/projects/b95e61f487394f089b5fb3ed1bd7e8cd/users/be2268ddebe14724987476b6a7dfe042/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:20.103316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:20.114728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f86b-c6a2-4df1-881e-ed5f41184921 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:20.173801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2238-b6c0-4b89-869c-7c3d031a417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:20.174424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2238-b6c0-4b89-869c-7c3d031a417d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:20.174759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2238-b6c0-4b89-869c-7c3d031a417d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:20.175062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2238-b6c0-4b89-869c-7c3d031a417d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:20.175775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b2238-b6c0-4b89-869c-7c3d031a417d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:20.177484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b2238-b6c0-4b89-869c-7c3d031a417d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:20.188264 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 923/1826] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:20.192535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:20.204052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd6f2-07d5-4287-b39b-45567bd29eee admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:20.209448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:20.210340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:20.210691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:20.211152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] PATH_INFO: `/v3/projects/b95e61f487394f089b5fb3ed1bd7e8cd/users/be2268ddebe14724987476b6a7dfe042/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:20.213043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95e61f487394f089b5fb3ed1bd7e8cd, user_id=be2268ddebe14724987476b6a7dfe042, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:20.215673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:20.227355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 904/1827] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:20 2022] PUT /identity/v3/projects/b95e61f487394f089b5fb3ed1bd7e8cd/users/be2268ddebe14724987476b6a7dfe042/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:20.239133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cfa80-2dd3-43f0-a89e-b014105c8417 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:20.239421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cfa80-2dd3-43f0-a89e-b014105c8417 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:20.239696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cfa80-2dd3-43f0-a89e-b014105c8417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:20.271451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d92cfa80-2dd3-43f0-a89e-b014105c8417 None None] MFA Rules not processed for user `be2268ddebe14724987476b6a7dfe042`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:20.272754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d92cfa80-2dd3-43f0-a89e-b014105c8417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:20.363755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 924/1828] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:20.371942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:20.442431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30360d41-73ea-428c-9b74-500f41e0d0fa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:20.448896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:20.449652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:20.449934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:20.450208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:20.516072 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:20.517722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:20.530313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 905/1829] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:21.046258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:21.359334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:21.707626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:22.033808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:22.176961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:22.690675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:22.896764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:24.809656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cfa80-2dd3-43f0-a89e-b014105c8417 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:24.823061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cfa80-2dd3-43f0-a89e-b014105c8417 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:24.837046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6902a4-d644-44c8-a2eb-c2a829087acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:24.841562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6902a4-d644-44c8-a2eb-c2a829087acf service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:24.841562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6902a4-d644-44c8-a2eb-c2a829087acf service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:24.841562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6902a4-d644-44c8-a2eb-c2a829087acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:24.853870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6902a4-d644-44c8-a2eb-c2a829087acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:24.855460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6902a4-d644-44c8-a2eb-c2a829087acf service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:24.867756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 925/1830] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:26.561512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:26.563595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:26.633174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ed8b1-bb76-4f38-8663-0a89681ae297 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:26.639199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:26.639933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:26.640241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:26.640851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] PATH_INFO: `/v3/users/1e53c1e31ddd4c57ac272a0fea0d16b9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:26.642279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e53c1e31ddd4c57ac272a0fea0d16b9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:26.644244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:26.673636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:26.828453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e53c1e31ddd4c57ac272a0fea0d16b9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:26.829138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e53c1e31ddd4c57ac272a0fea0d16b9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:26.843508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e53c1e31ddd4c57ac272a0fea0d16b9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:26.850791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e53c1e31ddd4c57ac272a0fea0d16b9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:26.851517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e53c1e31ddd4c57ac272a0fea0d16b9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:26.913493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 906/1831] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:26 2022] DELETE /identity/v3/users/1e53c1e31ddd4c57ac272a0fea0d16b9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:26.920955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:26.921416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:26.921929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:26.940868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:26.942078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:27.000658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 926/1832] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:27.010347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:27.011765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:27.070493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf41137-ad2a-4986-9213-b73036f2de9c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:27.074185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:27.074796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:27.075083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:27.075911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:27.086306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:27.087836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:27.098650 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 907/1833] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:27.526647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:27.533239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:27.551469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ca083-1732-452f-85fd-9cb592ffd16e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:27.567364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:27.568025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:27.573292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:27.573292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] PATH_INFO: `/v3/projects/e7488f7bccbc48d893105b097bd2fe4b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:27.573292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7488f7bccbc48d893105b097bd2fe4b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:27.573292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:27.702357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7488f7bccbc48d893105b097bd2fe4b', 'request_id': 'req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:27.708356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7488f7bccbc48d893105b097bd2fe4b', 'request_id': 'req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:27.793512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7488f7bccbc48d893105b097bd2fe4b', 'request_id': 'req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:27.806506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] The token cache is being invalidate because project e7488f7bccbc48d893105b097bd2fe4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:27.806792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:27.807454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:27.809123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 927/1834] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:27 2022] DELETE /identity/v3/projects/e7488f7bccbc48d893105b097bd2fe4b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:27.813989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:27.826474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449941-eae0-4ac6-b410-27b6b84c8a44 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:27.853089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:27.855015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:27.869917 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:27.894890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:27.895551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:27.895814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:27.896089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] PATH_INFO: `/v3/users/fb93f4efb4a048eea65505fbd5cbca7b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:27.897270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb93f4efb4a048eea65505fbd5cbca7b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:27.899409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:27.941594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4985-a8f3-4c8a-8ea5-064b21d20b2a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:27.949018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:27.949727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:27.950209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:27.951640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] PATH_INFO: `/v3/users/963f05c6bbac4b53897ad4be47e618a2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:27.953377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963f05c6bbac4b53897ad4be47e618a2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:27.955599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:28.195484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:28.198253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb93f4efb4a048eea65505fbd5cbca7b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.198978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb93f4efb4a048eea65505fbd5cbca7b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.213416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb93f4efb4a048eea65505fbd5cbca7b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.222890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb93f4efb4a048eea65505fbd5cbca7b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.223582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ad223b02-dc85-4a0f-b1fe-cfd8499df2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb93f4efb4a048eea65505fbd5cbca7b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.316315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 908/1835] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:27 2022] DELETE /identity/v3/users/fb93f4efb4a048eea65505fbd5cbca7b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:28.317404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7815-0c21-44cb-8c43-43eb54e4b4ab None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:28.317698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7815-0c21-44cb-8c43-43eb54e4b4ab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:28.317979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc7815-0c21-44cb-8c43-43eb54e4b4ab None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:28.333296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 909/1836] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:29:28 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:29:28.334685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:28.334973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:28.336111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:28.344914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963f05c6bbac4b53897ad4be47e618a2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.346370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963f05c6bbac4b53897ad4be47e618a2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.358974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:28.360242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:28.383686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963f05c6bbac4b53897ad4be47e618a2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.385587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963f05c6bbac4b53897ad4be47e618a2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.484575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ae2929ea-9b2b-446a-b60b-5eede31c2b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963f05c6bbac4b53897ad4be47e618a2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:28.510650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 928/1837] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:27 2022] DELETE /identity/v3/users/963f05c6bbac4b53897ad4be47e618a2 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:28.515897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:28.516456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:28.516888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:28.526463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 910/1838] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:28.546060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:28.547703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:28.626271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 929/1839] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:28.649187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:28.650713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:28.739665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48faa8d-7719-4c09-80af-81c9e3421698 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:28.813823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:28.819135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:28.819135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:28.819135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:28.832644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:28.834281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:28.873941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 911/1840] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:29.134166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:29.152981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:29.242134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53616-42a1-481d-b51c-797aee74840b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:29.249624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:29.250632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:29.251111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:29.251351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:29.277426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:29.281881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:29.296280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 930/1841] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:29.449450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:29.672103 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:29.678570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:29.693233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b711a-b391-45a9-a082-819e7dc97e1a service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:29.698233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:29.698957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:29.699153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:29.699436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] PATH_INFO: `/v3/projects/8856bbd007154387b3eb022104e630ab` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:29.701724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8856bbd007154387b3eb022104e630ab)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:29.703918 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:29.749166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:29.751212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:29.779428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3451e-136e-4d73-b36e-9c9213230344 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:29.797350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:29.799721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:29.800017 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:29.800557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] PATH_INFO: `/v3/projects/b40fced598404ee1ab2277acab614101` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:29.802669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40fced598404ee1ab2277acab614101)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:29.807364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:29.811535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:29.815026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8856bbd007154387b3eb022104e630ab', 'request_id': 'req-25f1fff4-ed65-4e20-8b89-e72f3d905d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:29.828186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8856bbd007154387b3eb022104e630ab', 'request_id': 'req-25f1fff4-ed65-4e20-8b89-e72f3d905d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:29.837509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8856bbd007154387b3eb022104e630ab', 'request_id': 'req-25f1fff4-ed65-4e20-8b89-e72f3d905d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:29.947564 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] The token cache is being invalidate because project 8856bbd007154387b3eb022104e630ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:29.947868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:29.951323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25f1fff4-ed65-4e20-8b89-e72f3d905d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:29.958094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 912/1842] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:29 2022] DELETE /identity/v3/projects/8856bbd007154387b3eb022104e630ab => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:29.959954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde923f-c3df-430e-a776-54ad23b715bf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:29.960285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde923f-c3df-430e-a776-54ad23b715bf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:29.960573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde923f-c3df-430e-a776-54ad23b715bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:29.964870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40fced598404ee1ab2277acab614101', 'request_id': 'req-bdeb7c72-1400-429b-814a-421ba5bc02ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:29.980473 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40fced598404ee1ab2277acab614101', 'request_id': 'req-bdeb7c72-1400-429b-814a-421ba5bc02ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.005132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9cde923f-c3df-430e-a776-54ad23b715bf None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:30.006380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9cde923f-c3df-430e-a776-54ad23b715bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:30.081644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40fced598404ee1ab2277acab614101', 'request_id': 'req-bdeb7c72-1400-429b-814a-421ba5bc02ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.114184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 913/1843] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:30.148830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4fb09-3792-4613-ae9c-19981825f591 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.148830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4fb09-3792-4613-ae9c-19981825f591 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.148830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4fb09-3792-4613-ae9c-19981825f591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.149162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] The token cache is being invalidate because project b40fced598404ee1ab2277acab614101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:30.149162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.149162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.149162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 931/1844] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:29 2022] DELETE /identity/v3/projects/b40fced598404ee1ab2277acab614101 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:30.149162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.161255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:30.186517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7cf4fb09-3792-4613-ae9c-19981825f591 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:30.188931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7cf4fb09-3792-4613-ae9c-19981825f591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:30.199469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb7c72-1400-429b-814a-421ba5bc02ca admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.207174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 914/1845] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:30.217189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4fb09-3792-4613-ae9c-19981825f591 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.230064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.237086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.237086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.237086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] PATH_INFO: `/v3/users/934046306a76409fb0d5db00f7491a01` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.237086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=934046306a76409fb0d5db00f7491a01)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.237381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4fb09-3792-4613-ae9c-19981825f591 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.240886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:30.245766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.248023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.248823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.249348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.250829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:30.252037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.254248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:30.271208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 915/1846] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:30.275682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.304468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3945a72-cb58-4dc8-9f26-69ae4b9786f3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.319403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.320661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.320969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.321259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.322047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.329807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:30.453283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 916/1847] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:30 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:30.457529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.521249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934046306a76409fb0d5db00f7491a01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.522209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934046306a76409fb0d5db00f7491a01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.532880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebf921-2c80-4b24-9708-8c6c94f15d1c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.538921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.539627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.539816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.540202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.540967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.543274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:30.545520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934046306a76409fb0d5db00f7491a01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.546773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934046306a76409fb0d5db00f7491a01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.610597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934046306a76409fb0d5db00f7491a01'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:30.648130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 917/1848] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:30 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:30.657532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 932/1849] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:30 2022] DELETE /identity/v3/users/934046306a76409fb0d5db00f7491a01 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:30.675820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.681617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:30.714739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2d0b1-4352-4169-84e1-7b994d349071 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.819998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.820734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.821129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.821592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.822292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.824094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:30.840662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 918/1850] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:30.843222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.854995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ba461-74c1-44da-b16c-18c16ca17bbf admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.860963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.861761 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.862126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.862538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.864007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.865073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:30.876766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 933/1851] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:30.881414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.893176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e90035-5d50-486b-8b54-7a6276ac4275 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.897430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025e83f-06f7-4817-80af-7edf22f2369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.898092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025e83f-06f7-4817-80af-7edf22f2369c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.898378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025e83f-06f7-4817-80af-7edf22f2369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.898669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025e83f-06f7-4817-80af-7edf22f2369c admin admin] PATH_INFO: `/v3/projects/c5a63d089d5a4817af9d6eb7b1c57b81/users/390d0dfcc2f248eab594280b38d0dae3/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.917413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025e83f-06f7-4817-80af-7edf22f2369c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a63d089d5a4817af9d6eb7b1c57b81, user_id=390d0dfcc2f248eab594280b38d0dae3, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.927272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025e83f-06f7-4817-80af-7edf22f2369c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:30.933791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:30.935781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:30.949293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ea69a-93fb-44c6-a612-8dce61ef1a54 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:30.956176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:30.956176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:30.956176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:30.956523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] PATH_INFO: `/v3/users/370586be9a27491c969d2dbc7e812068` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:30.957907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370586be9a27491c969d2dbc7e812068)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:30.959825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:31.010572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 919/1852] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:30 2022] PUT /identity/v3/projects/c5a63d089d5a4817af9d6eb7b1c57b81/users/390d0dfcc2f248eab594280b38d0dae3/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:31.022687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57d8a-3e10-4d80-b1c1-76a2c6485004 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.022979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57d8a-3e10-4d80-b1c1-76a2c6485004 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.023251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57d8a-3e10-4d80-b1c1-76a2c6485004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.054301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a8d57d8a-3e10-4d80-b1c1-76a2c6485004 None None] MFA Rules not processed for user `390d0dfcc2f248eab594280b38d0dae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:31.055515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a8d57d8a-3e10-4d80-b1c1-76a2c6485004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:31.128446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 920/1853] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:31.133118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57d8a-3e10-4d80-b1c1-76a2c6485004 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:31.193444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370586be9a27491c969d2dbc7e812068'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.194897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370586be9a27491c969d2dbc7e812068'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.212316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57d8a-3e10-4d80-b1c1-76a2c6485004 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:31.218320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:31.219286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.219785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.220262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.221266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:31.223791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:31.232130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370586be9a27491c969d2dbc7e812068'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.233152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370586be9a27491c969d2dbc7e812068'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.408828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370586be9a27491c969d2dbc7e812068'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.413385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 921/1854] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:31 2022] POST /identity/v3/projects => generated 379 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:31.414291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:31.416578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:31.429496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 934/1855] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:30 2022] DELETE /identity/v3/users/370586be9a27491c969d2dbc7e812068 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:31.433600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:31.437004 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:31.487234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d99cd6-f2bc-48c2-a00d-ee2bea547888 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:31.506310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c013f-5f27-42f8-97a3-14a6f6b5c8a6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:31.511804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a945ba7-ff86-467f-aa88-1d6e6f4b0c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:31.512747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945ba7-ff86-467f-aa88-1d6e6f4b0c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.513038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945ba7-ff86-467f-aa88-1d6e6f4b0c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.513321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a945ba7-ff86-467f-aa88-1d6e6f4b0c21 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.513971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945ba7-ff86-467f-aa88-1d6e6f4b0c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:31.516184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a945ba7-ff86-467f-aa88-1d6e6f4b0c21 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:31.534927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:31.574348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:31.575006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.576280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.576490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] PATH_INFO: `/v3/projects/40ae01a056854eb59e39c3dd05c20af4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.577939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ae01a056854eb59e39c3dd05c20af4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:31.579938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:31.662612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 935/1856] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:31 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:31.665149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105610cc-7c05-4dcd-835a-4ab4cbdb3973 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.665634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105610cc-7c05-4dcd-835a-4ab4cbdb3973 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.666365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105610cc-7c05-4dcd-835a-4ab4cbdb3973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.691357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-105610cc-7c05-4dcd-835a-4ab4cbdb3973 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:31.692598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-105610cc-7c05-4dcd-835a-4ab4cbdb3973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:31.701980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 936/1857] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:31.705101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105610cc-7c05-4dcd-835a-4ab4cbdb3973 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:31.715792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105610cc-7c05-4dcd-835a-4ab4cbdb3973 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:31.721423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:31.727354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.727354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.727354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.727354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:31.727354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:31.735960 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 937/1858] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:31.736997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:31.738640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:31.805602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ae01a056854eb59e39c3dd05c20af4', 'request_id': 'req-92d4efb0-12c0-4928-992d-ce2d7335302d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.811550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ae01a056854eb59e39c3dd05c20af4', 'request_id': 'req-92d4efb0-12c0-4928-992d-ce2d7335302d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.818064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ae01a056854eb59e39c3dd05c20af4', 'request_id': 'req-92d4efb0-12c0-4928-992d-ce2d7335302d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.821142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83547d-345a-40c9-9d7e-fb9c85b71958 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:31.871747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c3adb-642c-4031-a07e-0365467e694d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:31.872437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3adb-642c-4031-a07e-0365467e694d service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.872941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3adb-642c-4031-a07e-0365467e694d service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.873267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3adb-642c-4031-a07e-0365467e694d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.942581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c3adb-642c-4031-a07e-0365467e694d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:31.944341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c3adb-642c-4031-a07e-0365467e694d service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:31.944771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] The token cache is being invalidate because project 40ae01a056854eb59e39c3dd05c20af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:31.945697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.946471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:31.949761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 922/1859] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:31 2022] DELETE /identity/v3/projects/40ae01a056854eb59e39c3dd05c20af4 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:31.951528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:31.955574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:31.958714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 938/1860] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:31.959921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cc13-3d63-440a-a977-b84969cc4bf6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.960220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cc13-3d63-440a-a977-b84969cc4bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.961493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cc13-3d63-440a-a977-b84969cc4bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.975423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4efb0-12c0-4928-992d-ce2d7335302d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:31.983756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-46d1cc13-3d63-440a-a977-b84969cc4bf6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:31.985701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-46d1cc13-3d63-440a-a977-b84969cc4bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:31.988072 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:31.988923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:31.989364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:31.989650 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:31.991105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:31.993336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.000165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 939/1861] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:32.003218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803ef8-ecc4-40da-876f-20c371e0736c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.003614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803ef8-ecc4-40da-876f-20c371e0736c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.003976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec803ef8-ecc4-40da-876f-20c371e0736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.006833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 923/1862] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:32.012162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.030334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae754a7-3408-430c-976a-f16e9c49f852 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.035653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ec803ef8-ecc4-40da-876f-20c371e0736c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:32.037798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ec803ef8-ecc4-40da-876f-20c371e0736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:32.040023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb4957-3f4a-45a7-b98d-119601015435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.041478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb4957-3f4a-45a7-b98d-119601015435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.042043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb4957-3f4a-45a7-b98d-119601015435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.042768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb4957-3f4a-45a7-b98d-119601015435 admin admin] PATH_INFO: `/v3/projects/df8d144a99f84a4b8092047d072cba94/users/f7bc025055af426daa5276b14d4dcb24/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.050340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 940/1863] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:32.062165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec803ef8-ecc4-40da-876f-20c371e0736c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.063777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb4957-3f4a-45a7-b98d-119601015435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8d144a99f84a4b8092047d072cba94, user_id=f7bc025055af426daa5276b14d4dcb24, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.068357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb4957-3f4a-45a7-b98d-119601015435 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.073225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec803ef8-ecc4-40da-876f-20c371e0736c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.079779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.080572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.080923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.081299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.082159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:32.082630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.084379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.100233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 941/1864] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:32.108368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:32.110615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.124574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebceb3-a05c-493e-b2b4-8283d5ed4888 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.133565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.134289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.134732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.135091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.135824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.138846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.162139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 924/1865] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:32 2022] PUT /identity/v3/projects/df8d144a99f84a4b8092047d072cba94/users/f7bc025055af426daa5276b14d4dcb24/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:32.173558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece180-ac7f-4a64-a8ec-0a61fc4dd97c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.173908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece180-ac7f-4a64-a8ec-0a61fc4dd97c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.174191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eece180-ac7f-4a64-a8ec-0a61fc4dd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.206732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5eece180-ac7f-4a64-a8ec-0a61fc4dd97c None None] MFA Rules not processed for user `f7bc025055af426daa5276b14d4dcb24`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:32.218712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5eece180-ac7f-4a64-a8ec-0a61fc4dd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:32.275845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 942/1866] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:32 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:32.280655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.285172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 925/1867] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:32.289322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eece180-ac7f-4a64-a8ec-0a61fc4dd97c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.358283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3015ac-327a-4782-aa89-b341719ab148 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.363006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.363626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.363910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.364186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.364912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.366893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.373155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eece180-ac7f-4a64-a8ec-0a61fc4dd97c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.377828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.378431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.378711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.378986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.379647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.382325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.435486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 943/1868] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:32 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:32.436719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.438947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:32.451454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c1fb3-7b2d-46ce-8339-583e76889d0b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.456505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.457139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.457420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.457696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] PATH_INFO: `/v3/projects/bd26c9d8c5564cf78cd23077de968813` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.458971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd26c9d8c5564cf78cd23077de968813)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.461036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.479698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 926/1869] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:32 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:32.480664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.548897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8832f-6d12-4a2d-bcfa-6a0bfe97f5a8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.564795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd26c9d8c5564cf78cd23077de968813', 'request_id': 'req-eed486b5-f5b5-43db-8532-9acff417dd59'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.570493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd26c9d8c5564cf78cd23077de968813', 'request_id': 'req-eed486b5-f5b5-43db-8532-9acff417dd59'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.608311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.608929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.609213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.609487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.610126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.611703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.621275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 927/1870] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:32.622383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.633057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd26c9d8c5564cf78cd23077de968813', 'request_id': 'req-eed486b5-f5b5-43db-8532-9acff417dd59'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.633952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395251bd-873d-4997-adc2-d36abea98733 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.642459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.643817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.648690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.648690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.648690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.648690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.649227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] The token cache is being invalidate because project bd26c9d8c5564cf78cd23077de968813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:32.649560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.650190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.655559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 944/1871] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:32 2022] DELETE /identity/v3/projects/bd26c9d8c5564cf78cd23077de968813 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:32.656467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.657842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:32.677190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed486b5-f5b5-43db-8532-9acff417dd59 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.677190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.677190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.677190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.677579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.677579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.679087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.690935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 945/1872] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:32.691888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.693690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:32.707480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45255f0d-2165-4168-9d8c-3afaee67342b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.712282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.712902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.713193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.713471 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] PATH_INFO: `/v3/users/949c50fc2b244e70b7d8fc3ac59d2095` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.714671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949c50fc2b244e70b7d8fc3ac59d2095)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.716796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.719836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 928/1873] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:32 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:32.720590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.730305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbe748-8b13-496d-a9d7-d62c359ae6ec admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.735266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.735919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.736200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.736495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] PATH_INFO: `/v3/projects/eefa62579dec4ee08e227d1515a6792c/users/8426d185de224b65a9925578cfd8461b/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.752641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefa62579dec4ee08e227d1515a6792c, user_id=8426d185de224b65a9925578cfd8461b, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.755693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.826245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 929/1874] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:32 2022] PUT /identity/v3/projects/eefa62579dec4ee08e227d1515a6792c/users/8426d185de224b65a9925578cfd8461b/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:32.827130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:32.828942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:32.897079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949c50fc2b244e70b7d8fc3ac59d2095'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.898620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949c50fc2b244e70b7d8fc3ac59d2095'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.915287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949c50fc2b244e70b7d8fc3ac59d2095'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.916498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949c50fc2b244e70b7d8fc3ac59d2095'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:32.917769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6101b-353a-40c5-82fd-4364567546a4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:32.923928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e02b68-9fa0-4ed5-ae19-341d6d4f87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:32.924674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02b68-9fa0-4ed5-ae19-341d6d4f87ac admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.924951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02b68-9fa0-4ed5-ae19-341d6d4f87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.925228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02b68-9fa0-4ed5-ae19-341d6d4f87ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.925915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e02b68-9fa0-4ed5-ae19-341d6d4f87ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:32.927583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e02b68-9fa0-4ed5-ae19-341d6d4f87ac admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:32.937983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 930/1875] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:32.941674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:32.941964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:32.942298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:32.972751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] MFA Rules not processed for user `8426d185de224b65a9925578cfd8461b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:32.973971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:33.008969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949c50fc2b244e70b7d8fc3ac59d2095'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:33.038889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 946/1876] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:32 2022] DELETE /identity/v3/users/949c50fc2b244e70b7d8fc3ac59d2095 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:33.039877 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.041334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:33.068895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 931/1877] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:33.069790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.073643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:33.086191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62e531-2827-4ab3-904f-085f6753ed8f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.128810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af159264-8e8f-408f-9127-9214b30bb7f8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.149712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.150746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.151105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.151449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] PATH_INFO: `/v3/projects/ce7eba8bc3c44fee922697896f7fa3fd/users/97a0e5c9278846938acec38dcb80d63c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.173022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7eba8bc3c44fee922697896f7fa3fd, user_id=97a0e5c9278846938acec38dcb80d63c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.175992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.189007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.189781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.190138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.190482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.191637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.193844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.252046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:33.268419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 947/1878] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:33 2022] PUT /identity/v3/projects/ce7eba8bc3c44fee922697896f7fa3fd/users/97a0e5c9278846938acec38dcb80d63c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:33.269342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.343163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 932/1879] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:33 2022] POST /identity/v3/projects => generated 363 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:33.346532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.347872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708adfb-6e61-4ca0-8a5a-000ce5dc39f1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.482752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.483357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.488367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.488367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.488367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.488367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.498286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 948/1880] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:33.500829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92269950-0c67-4706-bc23-11eca3a84e5e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.506660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.520298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.521086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.521475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.521837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.522607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.529295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d4106-974c-4e7a-bc73-6c2b5e84a32a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.530001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.547032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285978de-d14f-4af2-8804-c44584308746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.547770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285978de-d14f-4af2-8804-c44584308746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.547982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285978de-d14f-4af2-8804-c44584308746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.548298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285978de-d14f-4af2-8804-c44584308746 admin admin] PATH_INFO: `/v3/projects/ce7eba8bc3c44fee922697896f7fa3fd/users/97a0e5c9278846938acec38dcb80d63c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.557675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285978de-d14f-4af2-8804-c44584308746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7eba8bc3c44fee922697896f7fa3fd, user_id=97a0e5c9278846938acec38dcb80d63c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.564117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285978de-d14f-4af2-8804-c44584308746 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.587539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:33.591938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 949/1881] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:33 2022] PUT /identity/v3/projects/ce7eba8bc3c44fee922697896f7fa3fd/users/97a0e5c9278846938acec38dcb80d63c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:33.603299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.603689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.604066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.643069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] MFA Rules not processed for user `97a0e5c9278846938acec38dcb80d63c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:33.645052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:33.674885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 933/1882] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:33 2022] POST /identity/v3/users => generated 288 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:33.682156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.691463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c560d3-5586-447b-a5b5-2f36c84b33b2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.732380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 950/1883] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:33.748936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.750996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:33.770105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.771345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.771709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.772553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.773662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.775589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.789549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 934/1884] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:33.790384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.793145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:33.808320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e2fa-a3e7-4605-b372-71addf6b37b2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.818929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e20af-8c37-4eb1-86a4-5e2d2faf6997 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.824062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.824851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.825462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.825672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.826849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.828076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.828671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.829203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] PATH_INFO: `/v3/projects/6cd8c925a4244bf28aa5906db56bd661` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.831485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd8c925a4244bf28aa5906db56bd661)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.835920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.838342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.839924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.851862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 951/1885] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:33.853464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.866318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50e99-c316-45f8-8fe1-a857ab4d90f5 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:33.873386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:33.874372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:33.874756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:33.875168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] PATH_INFO: `/v3/projects/b7c5bd622066477d9cfce2fbf63c1ba6/users/408c5603266646c4acf2c9e2c6afa432/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:33.894422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c5bd622066477d9cfce2fbf63c1ba6, user_id=408c5603266646c4acf2c9e2c6afa432, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:33.898619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:33.992197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 952/1886] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:33 2022] PUT /identity/v3/projects/b7c5bd622066477d9cfce2fbf63c1ba6/users/408c5603266646c4acf2c9e2c6afa432/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:33.993268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:33.994959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:34.017482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd8c925a4244bf28aa5906db56bd661', 'request_id': 'req-2188b2ab-1979-4ca9-a9d9-0624227aaa64'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:34.023703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd8c925a4244bf28aa5906db56bd661', 'request_id': 'req-2188b2ab-1979-4ca9-a9d9-0624227aaa64'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:34.033304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd8c925a4244bf28aa5906db56bd661', 'request_id': 'req-2188b2ab-1979-4ca9-a9d9-0624227aaa64'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:34.085798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a6fa-471c-4e10-815c-87d6df0b675d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:34.142674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] The token cache is being invalidate because project 6cd8c925a4244bf28aa5906db56bd661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:34.142969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:34.144059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:34.145995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 935/1887] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:33 2022] DELETE /identity/v3/projects/6cd8c925a4244bf28aa5906db56bd661 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:34.146629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:34.150999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:34.155934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dcefd-e10c-4bad-ba24-a55946efb6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:34.156608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dcefd-e10c-4bad-ba24-a55946efb6dc service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.157277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dcefd-e10c-4bad-ba24-a55946efb6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.157277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dcefd-e10c-4bad-ba24-a55946efb6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.158982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5f8dcefd-e10c-4bad-ba24-a55946efb6dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:34.244184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dcefd-e10c-4bad-ba24-a55946efb6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:34.245676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dcefd-e10c-4bad-ba24-a55946efb6dc service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:34.270119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188b2ab-1979-4ca9-a9d9-0624227aaa64 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:34.270702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 953/1888] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:34.274254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86448d-6557-4fd8-bb4b-041f8eb53783 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.274796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86448d-6557-4fd8-bb4b-041f8eb53783 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.275577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86448d-6557-4fd8-bb4b-041f8eb53783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.276702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:34.277666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.278213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.279686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.280751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:34.282792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:34.299214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 936/1889] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:34.303992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:34.339577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ac86448d-6557-4fd8-bb4b-041f8eb53783 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:34.341699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ac86448d-6557-4fd8-bb4b-041f8eb53783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:34.342645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566f8f-e84d-4eed-af23-2a67ccc51680 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:34.352338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 954/1890] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:34.363415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e819c7-49f0-4e2d-ae04-738dd802bcf4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.363955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e819c7-49f0-4e2d-ae04-738dd802bcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.364256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e819c7-49f0-4e2d-ae04-738dd802bcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.371460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b3389-3f07-4e0d-b144-d9b88d65db99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:34.373591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3389-3f07-4e0d-b144-d9b88d65db99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.373876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3389-3f07-4e0d-b144-d9b88d65db99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.374156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b3389-3f07-4e0d-b144-d9b88d65db99 admin admin] PATH_INFO: `/v3/projects/b7c5bd622066477d9cfce2fbf63c1ba6/users/408c5603266646c4acf2c9e2c6afa432/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.383763 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b3389-3f07-4e0d-b144-d9b88d65db99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c5bd622066477d9cfce2fbf63c1ba6, user_id=408c5603266646c4acf2c9e2c6afa432, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:34.392552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b3389-3f07-4e0d-b144-d9b88d65db99 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:34.420857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 937/1891] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:34 2022] PUT /identity/v3/projects/b7c5bd622066477d9cfce2fbf63c1ba6/users/408c5603266646c4acf2c9e2c6afa432/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:34.422122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-17e819c7-49f0-4e2d-ae04-738dd802bcf4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:34.423371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-17e819c7-49f0-4e2d-ae04-738dd802bcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:34.432769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48de0b-7da9-48e6-9600-4da476b0d55c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.433211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48de0b-7da9-48e6-9600-4da476b0d55c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.433611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48de0b-7da9-48e6-9600-4da476b0d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.467628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0e48de0b-7da9-48e6-9600-4da476b0d55c None None] MFA Rules not processed for user `408c5603266646c4acf2c9e2c6afa432`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:34.469116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e48de0b-7da9-48e6-9600-4da476b0d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:34.547681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 955/1892] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:34.548527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e819c7-49f0-4e2d-ae04-738dd802bcf4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:34.562310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e819c7-49f0-4e2d-ae04-738dd802bcf4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:34.573938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:34.574586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.576398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.576703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.580401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:34.580795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:34.583851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:34.601638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 938/1893] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:34.618076 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 956/1894] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:34.623787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48de0b-7da9-48e6-9600-4da476b0d55c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:34.626519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:34.628336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:34.641175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48de0b-7da9-48e6-9600-4da476b0d55c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:34.650458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:34.651598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.651981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.652626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.654076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:34.656343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:34.710314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b76399-5286-47be-8e4c-8cc311d6f078 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:34.716182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:34.717218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.717681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.718072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.731893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:34.734533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:34.748353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:34.762231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 957/1895] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:34.821343 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 939/1896] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:34 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:34.823192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:34.834030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691bc3-bdd0-4715-a62b-8630c04bb1b2 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:34.892494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:34.893175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:34.893458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:34.893735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:34.894402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:34.896432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:34.979191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:34.986099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 958/1897] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:34 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:34.990291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.001911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a237d-96ac-48f1-adee-73fb9ba6de46 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.006766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.009203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.009203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.009203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.009203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.010207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.021314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 940/1898] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:35.025407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.036090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bddf9-8ef0-485f-9f76-f0193cd00a23 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.041091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b5afc-4145-4a50-985c-1502416f1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.041706 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5afc-4145-4a50-985c-1502416f1800 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.041991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5afc-4145-4a50-985c-1502416f1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.042269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b5afc-4145-4a50-985c-1502416f1800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.042943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5afc-4145-4a50-985c-1502416f1800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.044718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b5afc-4145-4a50-985c-1502416f1800 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.058438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 959/1899] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:35.062020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.074848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c6fc-bdad-4695-8601-d838d746e665 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.080544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.081238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.081525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.081807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] PATH_INFO: `/v3/projects/8c031099eae343169789f090fe9863dc/users/692147c8cf4b4ca19edd50803bc50a64/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.099789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c031099eae343169789f090fe9863dc, user_id=692147c8cf4b4ca19edd50803bc50a64, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.102729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.189923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 941/1900] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:35 2022] PUT /identity/v3/projects/8c031099eae343169789f090fe9863dc/users/692147c8cf4b4ca19edd50803bc50a64/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:35.204579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58a21-020e-4b70-9df4-3f4aebf56d35 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.204579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58a21-020e-4b70-9df4-3f4aebf56d35 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.204579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58a21-020e-4b70-9df4-3f4aebf56d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.225913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.246355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2ac58a21-020e-4b70-9df4-3f4aebf56d35 None None] MFA Rules not processed for user `692147c8cf4b4ca19edd50803bc50a64`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:35.246355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2ac58a21-020e-4b70-9df4-3f4aebf56d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:35.295982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39cca-a01c-4ab0-a0b9-ed233347dfc4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.300389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.301056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.301376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.301656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.303696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:35.326920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 960/1901] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:35.331574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58a21-020e-4b70-9df4-3f4aebf56d35 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.368886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.370339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.384102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 942/1902] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:35.405135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58a21-020e-4b70-9df4-3f4aebf56d35 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.412171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.412171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.412171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.412171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.412537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.414061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.532467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.532671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 961/1903] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:35 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:35.542508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b700b5-b4ee-4559-865d-8afff24ba013 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.614604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.615359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.615689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.616027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.616758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.618753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.697064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 943/1904] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:35 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:35.703796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.715043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf55b50-9301-4982-a7aa-664c83af1e1d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.721586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.721586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.721880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.722170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.722844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.724456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.736598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 962/1905] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:35.741200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.752112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc26398-72a9-4f8b-b7ac-b770508a9949 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.757941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.758911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.759207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.759649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] PATH_INFO: `/v3/projects/42d2ee2431ac4be880cc4f351026ab4a/users/639685c4da584c608f9846b9166b5d25/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.787563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d2ee2431ac4be880cc4f351026ab4a, user_id=639685c4da584c608f9846b9166b5d25, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.792859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.808941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:INSERT=5,keystone:SELECT=78,keystone:DELETE=17 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:35.869237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 944/1906] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:35 2022] PUT /identity/v3/projects/42d2ee2431ac4be880cc4f351026ab4a/users/639685c4da584c608f9846b9166b5d25/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:35.875571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.889451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d24fb-2e57-4e52-bc1f-36db1259424f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.941568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:35.958607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333f19-e5ce-45ea-bcf8-183f09f535ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.959224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333f19-e5ce-45ea-bcf8-183f09f535ab admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.959514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333f19-e5ce-45ea-bcf8-183f09f535ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.959820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333f19-e5ce-45ea-bcf8-183f09f535ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:35.960640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65333f19-e5ce-45ea-bcf8-183f09f535ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:35.962242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65333f19-e5ce-45ea-bcf8-183f09f535ab admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:35.974005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 963/1907] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:29:35.977811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:35.991221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ae33-7732-4ffc-9c99-3eef099a46c5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:35.997653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:35.998683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:35.998940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:35.999285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] PATH_INFO: `/v3/projects/42d2ee2431ac4be880cc4f351026ab4a/users/639685c4da584c608f9846b9166b5d25/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:36.001504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d2ee2431ac4be880cc4f351026ab4a, user_id=639685c4da584c608f9846b9166b5d25, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:36.004388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:36.016335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 945/1908] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:35 2022] PUT /identity/v3/projects/42d2ee2431ac4be880cc4f351026ab4a/users/639685c4da584c608f9846b9166b5d25/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:36.027792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:36.028202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:36.028702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:36.063298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] MFA Rules not processed for user `639685c4da584c608f9846b9166b5d25`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:36.064566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:36.133662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 964/1909] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:36.145466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:36.201539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265420e-d3b4-4026-aa26-a4e553526f3b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:36.208220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:36.208863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:36.209204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:36.209620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:36.219378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:36.220914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:36.231784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 946/1910] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:36.338940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:36.340374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:36.352332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77583c7-ecfa-4104-aefd-1b324c75cd5a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:36.355848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:36.357054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:36.357540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:36.358024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:36.380541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:36.418405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:36.420687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:36.429040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:36.431130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 965/1911] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:36.783329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:36.874384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:37.108152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:37.199357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:37.640353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:38.245561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:39.353891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:39.355375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:39.429434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb30c06-9878-42b1-b088-eac23a358ba7 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:39.435243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:39.436831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:39.437173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:39.437455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] PATH_INFO: `/v3/users/390d0dfcc2f248eab594280b38d0dae3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:39.438756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390d0dfcc2f248eab594280b38d0dae3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:39.440820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:39.470571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:39.485306 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68093f-cf4a-4faa-8079-12e2459c63b6 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:39.491975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:39.492661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:39.492946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:39.493224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] PATH_INFO: `/v3/users/8426d185de224b65a9925578cfd8461b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:39.494356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8426d185de224b65a9925578cfd8461b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:39.496684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:39.657611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:39.682691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390d0dfcc2f248eab594280b38d0dae3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.683480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390d0dfcc2f248eab594280b38d0dae3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.708193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390d0dfcc2f248eab594280b38d0dae3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.717833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390d0dfcc2f248eab594280b38d0dae3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.718061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:39.719402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ae15918c-8eaa-4e6d-b169-7724e5443772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390d0dfcc2f248eab594280b38d0dae3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.728663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8426d185de224b65a9925578cfd8461b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.733314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8426d185de224b65a9925578cfd8461b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.749331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8426d185de224b65a9925578cfd8461b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.750763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8426d185de224b65a9925578cfd8461b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:39.861440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 947/1912] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:39 2022] DELETE /identity/v3/users/390d0dfcc2f248eab594280b38d0dae3 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:39.866344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:39.866712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:39.867085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:39.891536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:39.892856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:39.964695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 948/1913] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:39.975663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:39.977345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:39.998554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-24120949-8ff5-48a4-a70d-f725c5164b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8426d185de224b65a9925578cfd8461b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:40.011319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 966/1914] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:39 2022] DELETE /identity/v3/users/8426d185de224b65a9925578cfd8461b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:40.017015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9c000-1d44-43d3-8faa-e5a9d86c9a7a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:40.017308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9c000-1d44-43d3-8faa-e5a9d86c9a7a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:40.017589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9c000-1d44-43d3-8faa-e5a9d86c9a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:40.036820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eba32-800e-4f81-8e0a-9602deaad8af None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:40.039516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-dde9c000-1d44-43d3-8faa-e5a9d86c9a7a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:40.040801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dde9c000-1d44-43d3-8faa-e5a9d86c9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:40.087743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:40.088532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:40.088998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:40.089291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:40.104548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 967/1915] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:40.110068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:40.115023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9c000-1d44-43d3-8faa-e5a9d86c9a7a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:40.126495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9c000-1d44-43d3-8faa-e5a9d86c9a7a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:40.130277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:40.130869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:40.131152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:40.131481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:40.142173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:40.143926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:40.154684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 968/1916] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:40.159540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:40.161417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:40.173401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 949/1917] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:40.819316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:40.828707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:40.834819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:40.840611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:40.849610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646ef56-f31c-4463-ba09-88828af6eb5e service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:40.855156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:40.860198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:40.860198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:40.860198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] PATH_INFO: `/v3/projects/c5a63d089d5a4817af9d6eb7b1c57b81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:40.860198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a63d089d5a4817af9d6eb7b1c57b81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:40.860745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c339-30eb-437e-aa0b-32bca3a77de5 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:40.862708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:40.866310 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:40.867057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:40.867422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:40.868393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] PATH_INFO: `/v3/projects/eefa62579dec4ee08e227d1515a6792c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:40.882572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefa62579dec4ee08e227d1515a6792c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:40.886097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:41.010021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a63d089d5a4817af9d6eb7b1c57b81', 'request_id': 'req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.019268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a63d089d5a4817af9d6eb7b1c57b81', 'request_id': 'req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.090197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a63d089d5a4817af9d6eb7b1c57b81', 'request_id': 'req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.100808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefa62579dec4ee08e227d1515a6792c', 'request_id': 'req-d4723079-6b29-49a3-b2c9-8d07a23099ab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.107211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] The token cache is being invalidate because project c5a63d089d5a4817af9d6eb7b1c57b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:41.107588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.108318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.110137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 969/1918] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:40 2022] DELETE /identity/v3/projects/c5a63d089d5a4817af9d6eb7b1c57b81 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:41.111955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefa62579dec4ee08e227d1515a6792c', 'request_id': 'req-d4723079-6b29-49a3-b2c9-8d07a23099ab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.113983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:41.116710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:41.126824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefa62579dec4ee08e227d1515a6792c', 'request_id': 'req-d4723079-6b29-49a3-b2c9-8d07a23099ab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.173519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:41.221103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7cd0-fc23-4ec9-ae86-377074b1f619 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:41.231019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] The token cache is being invalidate because project eefa62579dec4ee08e227d1515a6792c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:41.231631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.232636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.234366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 950/1919] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:40 2022] DELETE /identity/v3/projects/eefa62579dec4ee08e227d1515a6792c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:41.238252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:41.239814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:41.296469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:41.297314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:41.297611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:41.297875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] PATH_INFO: `/v3/users/f7bc025055af426daa5276b14d4dcb24` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:41.299830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bc025055af426daa5276b14d4dcb24)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:41.303037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:41.314721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4723079-6b29-49a3-b2c9-8d07a23099ab admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:41.319554 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:41.320202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:41.320509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:41.320784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] PATH_INFO: `/v3/users/408c5603266646c4acf2c9e2c6afa432` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:41.321968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408c5603266646c4acf2c9e2c6afa432)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:41.323944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:41.490957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:41.496532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bc025055af426daa5276b14d4dcb24'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.498595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bc025055af426daa5276b14d4dcb24'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.500084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408c5603266646c4acf2c9e2c6afa432'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.500859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408c5603266646c4acf2c9e2c6afa432'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.511949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bc025055af426daa5276b14d4dcb24'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.512869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bc025055af426daa5276b14d4dcb24'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.514011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408c5603266646c4acf2c9e2c6afa432'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.521669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408c5603266646c4acf2c9e2c6afa432'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.522385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408c5603266646c4acf2c9e2c6afa432'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.608816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bc025055af426daa5276b14d4dcb24'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:41.621716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 970/1920] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:41 2022] DELETE /identity/v3/users/f7bc025055af426daa5276b14d4dcb24 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:41.682190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:41.683628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:41.702676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 951/1921] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:41 2022] DELETE /identity/v3/users/408c5603266646c4acf2c9e2c6afa432 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:41.774829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:41.776517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:41.786759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf118d92-5c67-49fd-88a0-6b671afce133 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:41.861007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:41.861818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:41.862111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:41.862776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] PATH_INFO: `/v3/users/692147c8cf4b4ca19edd50803bc50a64` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:41.863616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=692147c8cf4b4ca19edd50803bc50a64)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:41.866071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:41.900068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8489-dd40-4407-8be7-a13e7f0a2e77 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:41.915188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:41.916096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:41.916613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:41.917127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] PATH_INFO: `/v3/users/2cda595e84f04769a1f996bb92eea468` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:41.918596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cda595e84f04769a1f996bb92eea468)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:41.920805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:42.084704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692147c8cf4b4ca19edd50803bc50a64'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.085419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692147c8cf4b4ca19edd50803bc50a64'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.098086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692147c8cf4b4ca19edd50803bc50a64'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.098774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692147c8cf4b4ca19edd50803bc50a64'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.166510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cda595e84f04769a1f996bb92eea468'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.167200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cda595e84f04769a1f996bb92eea468'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.186221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cda595e84f04769a1f996bb92eea468'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.194718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cda595e84f04769a1f996bb92eea468'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.195534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-17dc79d8-7140-4519-b9d9-24501d5765a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cda595e84f04769a1f996bb92eea468'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.204201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692147c8cf4b4ca19edd50803bc50a64'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.220020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 971/1922] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:41 2022] DELETE /identity/v3/users/692147c8cf4b4ca19edd50803bc50a64 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:42.227926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:42.229333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.295743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 952/1923] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:41 2022] DELETE /identity/v3/users/2cda595e84f04769a1f996bb92eea468 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:42.299633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.299633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.299633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.321549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d847906-353e-431a-bd56-ab3152e6c88f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:42.327373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:42.329198 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.346914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:42.391546 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:42.392682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.392892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.393393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] PATH_INFO: `/v3/projects/df8d144a99f84a4b8092047d072cba94` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.394657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8d144a99f84a4b8092047d072cba94)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:42.397332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:42.403037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 953/1924] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:42.404017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:42.405430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.417350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f45b-2ea3-4a05-921a-35a7bf19d06f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:42.423742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:42.424465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.424715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.425278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] PATH_INFO: `/v3/projects/b7c5bd622066477d9cfce2fbf63c1ba6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.426478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c5bd622066477d9cfce2fbf63c1ba6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:42.428484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:42.558646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8d144a99f84a4b8092047d072cba94', 'request_id': 'req-54926ffb-4364-4ea0-a040-a792121067dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.564298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8d144a99f84a4b8092047d072cba94', 'request_id': 'req-54926ffb-4364-4ea0-a040-a792121067dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.587795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c5bd622066477d9cfce2fbf63c1ba6', 'request_id': 'req-3eb28f75-fb11-42bf-883b-dad2a0048087'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.593896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c5bd622066477d9cfce2fbf63c1ba6', 'request_id': 'req-3eb28f75-fb11-42bf-883b-dad2a0048087'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.600023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c5bd622066477d9cfce2fbf63c1ba6', 'request_id': 'req-3eb28f75-fb11-42bf-883b-dad2a0048087'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.649989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8d144a99f84a4b8092047d072cba94', 'request_id': 'req-54926ffb-4364-4ea0-a040-a792121067dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.662648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] The token cache is being invalidate because project df8d144a99f84a4b8092047d072cba94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:42.662936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.663608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54926ffb-4364-4ea0-a040-a792121067dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.665438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 972/1925] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:42 2022] DELETE /identity/v3/projects/df8d144a99f84a4b8092047d072cba94 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:42.666342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.666625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.666899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.686250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:42.687433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.724277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] The token cache is being invalidate because project b7c5bd622066477d9cfce2fbf63c1ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:42.724642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.725354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:42.727154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 954/1926] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:42 2022] DELETE /identity/v3/projects/b7c5bd622066477d9cfce2fbf63c1ba6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:42.727982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:42.729551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.748693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 973/1927] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:42.749660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:42.751635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.765533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ae12-c243-4970-9422-91dcac8303e4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:42.770621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:42.771313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.771541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.771847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] PATH_INFO: `/v3/users/97a0e5c9278846938acec38dcb80d63c` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.773054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a0e5c9278846938acec38dcb80d63c)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:42.775131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:42.794994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28f75-fb11-42bf-883b-dad2a0048087 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:42.799373 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4033523-fe66-4fe2-9680-711af5b4c4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:42.800179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4033523-fe66-4fe2-9680-711af5b4c4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.801056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4033523-fe66-4fe2-9680-711af5b4c4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.801056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4033523-fe66-4fe2-9680-711af5b4c4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.802973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e4033523-fe66-4fe2-9680-711af5b4c4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.815537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4033523-fe66-4fe2-9680-711af5b4c4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:42.817069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4033523-fe66-4fe2-9680-711af5b4c4d1 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:42.827246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 955/1928] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:42.828625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.828793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.829051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.839066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:42.851425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:42.852277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.861073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 956/1929] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:42.862137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:42.870638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:42.883936 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb2a23-e639-4e40-85dd-08b55a7f4407 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:42.888982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7961ec-dc2a-48c3-bfe7-efc02c154d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:42.889615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7961ec-dc2a-48c3-bfe7-efc02c154d24 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.889892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7961ec-dc2a-48c3-bfe7-efc02c154d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.890171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7961ec-dc2a-48c3-bfe7-efc02c154d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.899794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7961ec-dc2a-48c3-bfe7-efc02c154d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:42.901264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7961ec-dc2a-48c3-bfe7-efc02c154d24 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:42.912165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 957/1930] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:42.913558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dca4d-f548-44cc-8039-0999cc8c1430 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:42.913850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dca4d-f548-44cc-8039-0999cc8c1430 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:42.914123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dca4d-f548-44cc-8039-0999cc8c1430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:42.997710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cc8dca4d-f548-44cc-8039-0999cc8c1430 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:42.999116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cc8dca4d-f548-44cc-8039-0999cc8c1430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:43.003245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a0e5c9278846938acec38dcb80d63c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.003993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a0e5c9278846938acec38dcb80d63c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.008443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 958/1931] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:43.013748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dca4d-f548-44cc-8039-0999cc8c1430 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.020959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a0e5c9278846938acec38dcb80d63c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.021788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a0e5c9278846938acec38dcb80d63c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.023367 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dca4d-f548-44cc-8039-0999cc8c1430 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.027915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.029438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.029861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.030142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.031740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:43.031740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.032756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.048104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 959/1932] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:29:43.049372 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.050919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:43.065823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c6980-8d2c-49af-b488-eb23f1ad90be admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.070900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.071512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.071816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.072244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.072874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.074776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.101826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a0e5c9278846938acec38dcb80d63c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.118436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 974/1933] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:42 2022] DELETE /identity/v3/users/97a0e5c9278846938acec38dcb80d63c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:43.154337 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 960/1934] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:43 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:43.158820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.245590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640a897-2839-44f7-be26-ee800b1e5fb1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.293988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:43.313261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.314052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.314200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.314403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.315043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.317000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.390013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 975/1935] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:43 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:43.394254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.405357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa787d-cc85-4012-a55f-7ef5a481057a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.410392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.412285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.412285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.412285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.412285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.414026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.416797 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.418623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:43.426724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 961/1936] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:43.431841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.432399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5188db-82a6-4a61-a923-ac0d08abc9f0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.437929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.438774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.439027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.439365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] PATH_INFO: `/v3/projects/4c3c4e4ff587452a8feb793bdd2b5362` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.441172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3c4e4ff587452a8feb793bdd2b5362)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.442826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.443437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b88d-b1dc-4a82-94ae-928a33f373c4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.448339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.449127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.449448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.449622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.450353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.451931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.464452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 962/1937] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:43.470764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.476804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:43.497719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddffb5-3190-4afd-9a37-5b45d082b7c0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.511461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.512353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.512559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.513213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] PATH_INFO: `/v3/projects/8c031099eae343169789f090fe9863dc` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.514616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c031099eae343169789f090fe9863dc)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.516632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.571548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3c4e4ff587452a8feb793bdd2b5362', 'request_id': 'req-5cd55130-3c19-4093-abf7-2e08a68a4773'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.577569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3c4e4ff587452a8feb793bdd2b5362', 'request_id': 'req-5cd55130-3c19-4093-abf7-2e08a68a4773'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.655960 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3c4e4ff587452a8feb793bdd2b5362', 'request_id': 'req-5cd55130-3c19-4093-abf7-2e08a68a4773'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.656770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:43.659964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c031099eae343169789f090fe9863dc', 'request_id': 'req-1a4fedd0-19d7-47e6-8ff7-803648b42b95'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.665602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c031099eae343169789f090fe9863dc', 'request_id': 'req-1a4fedd0-19d7-47e6-8ff7-803648b42b95'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.675480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c031099eae343169789f090fe9863dc', 'request_id': 'req-1a4fedd0-19d7-47e6-8ff7-803648b42b95'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.685370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] The token cache is being invalidate because project 4c3c4e4ff587452a8feb793bdd2b5362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:43.692630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.692630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.692630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 976/1938] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:43 2022] DELETE /identity/v3/projects/4c3c4e4ff587452a8feb793bdd2b5362 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:43.692948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.694379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:43.763895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd55130-3c19-4093-abf7-2e08a68a4773 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.777780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] The token cache is being invalidate because project 8c031099eae343169789f090fe9863dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:43.778757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.779802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:43.781741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 963/1939] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:43 2022] DELETE /identity/v3/projects/8c031099eae343169789f090fe9863dc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:43.782538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.783858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:43.843224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.843968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.844285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.844575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] PATH_INFO: `/v3/projects/019dd635db0942d49fc584ac37e9210f/users/1f3f08a29d1b4f1cb42e830771ea60b5/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.864185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019dd635db0942d49fc584ac37e9210f, user_id=1f3f08a29d1b4f1cb42e830771ea60b5, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.867536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.896236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fedd0-19d7-47e6-8ff7-803648b42b95 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:43.896868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:43.898010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:43.898297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:43.899429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] PATH_INFO: `/v3/users/be2268ddebe14724987476b6a7dfe042` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:43.913769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2268ddebe14724987476b6a7dfe042)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:43.919879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:43.937089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 977/1940] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:43 2022] PUT /identity/v3/projects/019dd635db0942d49fc584ac37e9210f/users/1f3f08a29d1b4f1cb42e830771ea60b5/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:43.946952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:43.946952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.015018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63549e4-4e42-42b5-8b69-272b71c688a3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:44.021913 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:44.022554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.022847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.023135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] PATH_INFO: `/v3/users/639685c4da584c608f9846b9166b5d25` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.024317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639685c4da584c608f9846b9166b5d25)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:44.027677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:44.108618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2268ddebe14724987476b6a7dfe042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.109336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2268ddebe14724987476b6a7dfe042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.122322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2268ddebe14724987476b6a7dfe042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.129384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2268ddebe14724987476b6a7dfe042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.129996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2268ddebe14724987476b6a7dfe042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.191692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 964/1941] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:43 2022] DELETE /identity/v3/users/be2268ddebe14724987476b6a7dfe042 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:44.192575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:44.193897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.230271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639685c4da584c608f9846b9166b5d25'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.230866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639685c4da584c608f9846b9166b5d25'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.245217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639685c4da584c608f9846b9166b5d25'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.246021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639685c4da584c608f9846b9166b5d25'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.270602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5f347-ef90-4ce0-b89d-bca37e6272b5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:44.275628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:44.276471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.276586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.276842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] PATH_INFO: `/v3/projects/ce7eba8bc3c44fee922697896f7fa3fd` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.277971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7eba8bc3c44fee922697896f7fa3fd)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:44.280497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:44.341952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7ce6714a-b07e-412b-846e-39e23da2c695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639685c4da584c608f9846b9166b5d25'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.354633 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 978/1942] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:43 2022] DELETE /identity/v3/users/639685c4da584c608f9846b9166b5d25 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:44.355887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.356172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.356624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.385394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] MFA Rules not processed for user `1f3f08a29d1b4f1cb42e830771ea60b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:44.388302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.391397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7eba8bc3c44fee922697896f7fa3fd', 'request_id': 'req-c0c3a60b-f72e-4801-8ea1-95284799348c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.397018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7eba8bc3c44fee922697896f7fa3fd', 'request_id': 'req-c0c3a60b-f72e-4801-8ea1-95284799348c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.404445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7eba8bc3c44fee922697896f7fa3fd', 'request_id': 'req-c0c3a60b-f72e-4801-8ea1-95284799348c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.427242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:44.466790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 979/1943] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:44.473258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:44.474640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.488706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] The token cache is being invalidate because project ce7eba8bc3c44fee922697896f7fa3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:44.489241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.490441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c0c3a60b-f72e-4801-8ea1-95284799348c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:44.492958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 965/1944] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:44 2022] DELETE /identity/v3/projects/ce7eba8bc3c44fee922697896f7fa3fd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:44.500081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717fb5b-8969-4a68-b274-7c0ff0bac1d4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.502910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717fb5b-8969-4a68-b274-7c0ff0bac1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.502910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717fb5b-8969-4a68-b274-7c0ff0bac1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.534732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1717fb5b-8969-4a68-b274-7c0ff0bac1d4 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:44.536145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1717fb5b-8969-4a68-b274-7c0ff0bac1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.570340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695f33-e457-47d7-8de0-557a17eb4d25 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:44.580033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:44.581424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.581889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.582370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.583181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:44.586003 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:44.610151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 966/1945] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:44.620726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6950b-a8d1-4e2c-81ef-96ff3bcc414f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.621100 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6950b-a8d1-4e2c-81ef-96ff3bcc414f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.621450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6950b-a8d1-4e2c-81ef-96ff3bcc414f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.643623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c7a6950b-a8d1-4e2c-81ef-96ff3bcc414f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:44.644946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c7a6950b-a8d1-4e2c-81ef-96ff3bcc414f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.653030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 967/1946] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:44.660578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6950b-a8d1-4e2c-81ef-96ff3bcc414f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:44.672164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6950b-a8d1-4e2c-81ef-96ff3bcc414f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:44.677238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:44.678090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.678671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.678896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.679989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:44.679989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:44.681708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:44.696440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 968/1947] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:29:44.701784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:44.715211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae5ea-0f69-466a-a4b6-b2d751841d03 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:44.721224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:44.724353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.724781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 980/1948] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:44 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:44.724875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.724875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.724875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:44.725743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:44.726179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:44.728402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.796094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:44.831055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 969/1949] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:44 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:44.831995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:44.837273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:44.875876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402f8ac-222a-44cb-89fd-475a97098f24 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:44.975661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:44.978480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.982068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.982068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:44.982068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:44.983748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e0f05-aa36-41c0-93cc-9fb01702297b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:44.986925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:44.991447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:44.992105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:44.992430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:44.992713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] PATH_INFO: `/v3/projects/b95e61f487394f089b5fb3ed1bd7e8cd` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.001969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95e61f487394f089b5fb3ed1bd7e8cd)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.004281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.097926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 981/1950] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:44 2022] POST /identity/v3/users => generated 291 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:45.101824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.120119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db5b27-869c-4b3a-a52f-dd555b8ef471 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.127263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.128676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.129385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.129775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.131066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.136204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.149822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95e61f487394f089b5fb3ed1bd7e8cd', 'request_id': 'req-964f0beb-dc56-428a-99bb-622028fe1731'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:45.159138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95e61f487394f089b5fb3ed1bd7e8cd', 'request_id': 'req-964f0beb-dc56-428a-99bb-622028fe1731'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:45.166750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95e61f487394f089b5fb3ed1bd7e8cd', 'request_id': 'req-964f0beb-dc56-428a-99bb-622028fe1731'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:45.245219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 982/1951] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:45 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:45.245778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.267050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d586636-5daf-4cd4-90ae-9bba611161a7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.331092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] The token cache is being invalidate because project b95e61f487394f089b5fb3ed1bd7e8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:45.331401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:45.332381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:45.333962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 970/1952] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:44 2022] DELETE /identity/v3/projects/b95e61f487394f089b5fb3ed1bd7e8cd => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:45.336921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.336921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:45.358533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9a4e2-c06d-4308-a1fa-30e5e2e2b56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.359274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a4e2-c06d-4308-a1fa-30e5e2e2b56c admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.359773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a4e2-c06d-4308-a1fa-30e5e2e2b56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.360128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a4e2-c06d-4308-a1fa-30e5e2e2b56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.360916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9a4e2-c06d-4308-a1fa-30e5e2e2b56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.362804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9a4e2-c06d-4308-a1fa-30e5e2e2b56c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.391319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 983/1953] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:45.396095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.396457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.396742 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.423987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:45.426565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:45.431189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f0beb-dc56-428a-99bb-622028fe1731 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.438328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 984/1954] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:45.438946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8409a40-5ea7-4a96-b138-a910b791d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.439476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.439812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409a40-5ea7-4a96-b138-a910b791d550 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.440478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409a40-5ea7-4a96-b138-a910b791d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.440843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8409a40-5ea7-4a96-b138-a910b791d550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.441577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8409a40-5ea7-4a96-b138-a910b791d550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.441882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:45.443424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8409a40-5ea7-4a96-b138-a910b791d550 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.458156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 971/1955] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:45.461449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15323bd-cd98-40b8-8f98-d3ab83cd6b09 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.462902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfc8dc-4f0b-4a0b-97b5-032636c215a9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.463360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfc8dc-4f0b-4a0b-97b5-032636c215a9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.463718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfc8dc-4f0b-4a0b-97b5-032636c215a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.469452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.470386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.470828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.471576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] PATH_INFO: `/v3/projects/385bf094388842c2b8437b03b40653b9/users/667fe5fbb53541658db9496c71d5e16a/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.489542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6ddfc8dc-4f0b-4a0b-97b5-032636c215a9 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:45.491601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ddfc8dc-4f0b-4a0b-97b5-032636c215a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:45.497289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385bf094388842c2b8437b03b40653b9, user_id=667fe5fbb53541658db9496c71d5e16a, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.502303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 972/1956] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:45.503338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfc8dc-4f0b-4a0b-97b5-032636c215a9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.514622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.516442 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfc8dc-4f0b-4a0b-97b5-032636c215a9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.521683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.522549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.522906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.523258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.524596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.526972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.539238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 973/1957] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:45.544280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.556048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d69069-2b8a-43e3-99b1-54a23d1c7c15 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.561811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.562593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.562948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.563437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.564234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:45.564951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.566733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.584357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 974/1958] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:45.584357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.597925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46180ad8-5227-41c3-9fd2-020cbad7e536 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.603878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 985/1959] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:45 2022] PUT /identity/v3/projects/385bf094388842c2b8437b03b40653b9/users/667fe5fbb53541658db9496c71d5e16a/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:45.605866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.642530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:45.691177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.692285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.692285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.692698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] PATH_INFO: `/v3/projects/0e071bef57ea46fda0129eb08352bfe7/users/332ca7c7571c4045b8c9b96774e870b0/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.717192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e071bef57ea46fda0129eb08352bfe7, user_id=332ca7c7571c4045b8c9b96774e870b0, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.720702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.735406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c81ee-7739-4b64-bd07-0481883f3c09 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.741824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad1ee6-5d21-4352-bcc9-6ab791121ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:45.745232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad1ee6-5d21-4352-bcc9-6ab791121ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.745232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad1ee6-5d21-4352-bcc9-6ab791121ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.745232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad1ee6-5d21-4352-bcc9-6ab791121ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.745232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad1ee6-5d21-4352-bcc9-6ab791121ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:45.746507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad1ee6-5d21-4352-bcc9-6ab791121ad4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:45.816584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 975/1960] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:45 2022] PUT /identity/v3/projects/0e071bef57ea46fda0129eb08352bfe7/users/332ca7c7571c4045b8c9b96774e870b0/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:45.842948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:45.911817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 986/1961] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:45 2022] POST /identity/v3/projects => generated 381 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:45.913269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:45.913567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:45.913849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:45.951641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a67d-b1e2-4cdc-942d-79d806c4ff97 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:45.978176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] MFA Rules not processed for user `332ca7c7571c4045b8c9b96774e870b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:45.986110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.025551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.026196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.026481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.026758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.027471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.029408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.047231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 976/1962] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:46.050549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.062282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40915c1-fe4d-4a3c-9573-f955e7867612 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.070898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.072056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.072577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.073299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.075396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.078397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.089315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:46.128573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 987/1963] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:46.129734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.131108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.149810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770efb52-ab81-4f61-ae84-482a4d21355a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.154901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.159524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.159524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.159524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] PATH_INFO: `/v3/projects/42d2ee2431ac4be880cc4f351026ab4a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.159524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d2ee2431ac4be880cc4f351026ab4a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.159524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.204011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 977/1964] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:46 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:46.205253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.218225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea04cf-c5b8-4395-9c19-69a59cf4c72e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.223974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.224734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.225010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.225297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] PATH_INFO: `/v3/projects/385bf094388842c2b8437b03b40653b9/users/667fe5fbb53541658db9496c71d5e16a/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.227472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] RBAC: Authorizing `identity:create_grant(project_id=385bf094388842c2b8437b03b40653b9, user_id=667fe5fbb53541658db9496c71d5e16a, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.234167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.243546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 978/1965] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:46 2022] PUT /identity/v3/projects/385bf094388842c2b8437b03b40653b9/users/667fe5fbb53541658db9496c71d5e16a/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:46.244415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.317212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d2ee2431ac4be880cc4f351026ab4a', 'request_id': 'req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:46.330637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d2ee2431ac4be880cc4f351026ab4a', 'request_id': 'req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:46.380513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e8c5e-fba5-4945-bfb4-51e4298c252b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.449492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a215c4-a213-49be-824d-d11d89940355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.450150 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a215c4-a213-49be-824d-d11d89940355 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.450557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a215c4-a213-49be-824d-d11d89940355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.450863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a215c4-a213-49be-824d-d11d89940355 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.451493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a215c4-a213-49be-824d-d11d89940355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.453581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a215c4-a213-49be-824d-d11d89940355 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.460983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d2ee2431ac4be880cc4f351026ab4a', 'request_id': 'req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:46.474427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] The token cache is being invalidate because project 42d2ee2431ac4be880cc4f351026ab4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:46.478389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:46.478389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:46.478389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 988/1966] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:46 2022] DELETE /identity/v3/projects/42d2ee2431ac4be880cc4f351026ab4a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:46.478389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.479647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.493789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690ea8b-0a89-4911-9abf-2f2ec108ee7d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.498785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6d153-1cd0-45d3-9a27-ef6b98b71681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.499553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d153-1cd0-45d3-9a27-ef6b98b71681 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.499973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d153-1cd0-45d3-9a27-ef6b98b71681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.500350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d153-1cd0-45d3-9a27-ef6b98b71681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.501077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6d153-1cd0-45d3-9a27-ef6b98b71681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.502786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6d153-1cd0-45d3-9a27-ef6b98b71681 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.513434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 989/1967] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:46.518075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2be08-7226-42bc-9052-bf78c7db995a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.518372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2be08-7226-42bc-9052-bf78c7db995a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.518656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2be08-7226-42bc-9052-bf78c7db995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.547639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-89c2be08-7226-42bc-9052-bf78c7db995a None None] MFA Rules not processed for user `667fe5fbb53541658db9496c71d5e16a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:46.548897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-89c2be08-7226-42bc-9052-bf78c7db995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.602228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 979/1968] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:46 2022] POST /identity/v3/projects => generated 383 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:46.603732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.604133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.604805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.624384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 990/1969] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:46.625238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2be08-7226-42bc-9052-bf78c7db995a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.631837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:46.632791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.635541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2be08-7226-42bc-9052-bf78c7db995a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.704447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.705068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.705361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.705741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.706004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 980/1970] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:46.706293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.706845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.708039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.708145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.723055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 991/1971] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:46.723055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.723309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d133f6-1dbd-4694-8a4e-29bef90edc30 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.724086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.727829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c9143-52b0-4efc-bdde-f4357d7c8682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.728548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9143-52b0-4efc-bdde-f4357d7c8682 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.729050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9143-52b0-4efc-bdde-f4357d7c8682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.729362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9143-52b0-4efc-bdde-f4357d7c8682 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.730127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9143-52b0-4efc-bdde-f4357d7c8682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.732791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9143-52b0-4efc-bdde-f4357d7c8682 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.789260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ab82e-05a9-41ef-bde2-2d2aca7cebb3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.793336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.794489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.794800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.795076 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.825613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 981/1972] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:46 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:46.826978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5099bf-a432-46d6-9df5-24d077f7e290 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.827273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5099bf-a432-46d6-9df5-24d077f7e290 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.827556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5099bf-a432-46d6-9df5-24d077f7e290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.850672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ea5099bf-a432-46d6-9df5-24d077f7e290 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:46.852019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ea5099bf-a432-46d6-9df5-24d077f7e290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:46.860762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 982/1973] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:46.862526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5099bf-a432-46d6-9df5-24d077f7e290 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.866642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.868904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.875583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5099bf-a432-46d6-9df5-24d077f7e290 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.882386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.883611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 992/1974] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:46.884776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.896792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.897243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.897608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f63001-704b-407d-aaba-55e2c1900eb1 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.899445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:46.899727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] PATH_INFO: `/v3/projects/51c40b72a93444a39a90153cd1023023/users/bc2761b0688144a38567063bd637fd89/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.904976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.905631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.905921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.906201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.906954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.908619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.925639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 993/1975] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:46.925822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c40b72a93444a39a90153cd1023023, user_id=bc2761b0688144a38567063bd637fd89, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.925935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.926798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.936579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc044eb5-1ef9-46ff-b746-2e80f3152e7c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.941626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.942274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.942557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.942888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.943497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:46.943942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.945700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.961968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 994/1976] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:46.961968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:46.973176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6409a1a-16cc-4604-bb61-9343e23baf3d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:46.978284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:46.978891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:46.979268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:46.979548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:46.980194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:46.982441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:46.992776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 995/1977] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:46.997438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.004295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8ec0-9a8f-4373-abad-f7709282b6b7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:47.010647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377acb7b-1ba9-43c0-8380-ab9ef0774535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:47.011284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acb7b-1ba9-43c0-8380-ab9ef0774535 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.011849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acb7b-1ba9-43c0-8380-ab9ef0774535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.012122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acb7b-1ba9-43c0-8380-ab9ef0774535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.013170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377acb7b-1ba9-43c0-8380-ab9ef0774535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:47.015136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377acb7b-1ba9-43c0-8380-ab9ef0774535 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:47.225815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 983/1978] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:46 2022] PUT /identity/v3/projects/51c40b72a93444a39a90153cd1023023/users/bc2761b0688144a38567063bd637fd89/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:47.225815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.240318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 996/1979] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:46 2022] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:47.242165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1292e1-3d8f-471d-b252-b88ed92bc961 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.242482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1292e1-3d8f-471d-b252-b88ed92bc961 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.242763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1292e1-3d8f-471d-b252-b88ed92bc961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.277345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cb1292e1-3d8f-471d-b252-b88ed92bc961 None None] MFA Rules not processed for user `bc2761b0688144a38567063bd637fd89`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:47.279668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cb1292e1-3d8f-471d-b252-b88ed92bc961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:47.346336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b0745-ea0a-4047-a64f-5f7693fb470f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:47.395342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 997/1980] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:47.395974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1292e1-3d8f-471d-b252-b88ed92bc961 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.439993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:47.472863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:47.473910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.473910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.474276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] PATH_INFO: `/v3/projects/9375adb092ad48788b2c441cd91fe31c/users/0c53fb1063ad40878cc0402e46d3cc79/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.509299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1292e1-3d8f-471d-b252-b88ed92bc961 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:47.514189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9375adb092ad48788b2c441cd91fe31c, user_id=0c53fb1063ad40878cc0402e46d3cc79, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:47.516898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:47.517197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:47.517749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.518098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.518439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.519311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:47.522458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:47.649857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 984/1981] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:47 2022] PUT /identity/v3/projects/9375adb092ad48788b2c441cd91fe31c/users/0c53fb1063ad40878cc0402e46d3cc79/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:47.649857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.650130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 998/1982] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:47 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:47.650130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.675402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d1587-2968-48b5-9b60-8ee0f9351912 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:47.738025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693feb3-16ff-49a6-bcc6-6405c3c47c22 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:47.752783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:47.753437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.753727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.754007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.754663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:47.756731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:47.786528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:47.792063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbae24f-f0e8-4758-9cf7-9027f5e0cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:47.792861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbae24f-f0e8-4758-9cf7-9027f5e0cb1e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.793243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbae24f-f0e8-4758-9cf7-9027f5e0cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.793717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbae24f-f0e8-4758-9cf7-9027f5e0cb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.794629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbae24f-f0e8-4758-9cf7-9027f5e0cb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:47.796487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbae24f-f0e8-4758-9cf7-9027f5e0cb1e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:47.808170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 999/1983] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:47.812970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd05f7-e8c0-4919-9f1e-fe4a0d8d6afb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.813263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd05f7-e8c0-4919-9f1e-fe4a0d8d6afb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.815846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd05f7-e8c0-4919-9f1e-fe4a0d8d6afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.853600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-50cd05f7-e8c0-4919-9f1e-fe4a0d8d6afb None None] MFA Rules not processed for user `0c53fb1063ad40878cc0402e46d3cc79`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:47.854825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-50cd05f7-e8c0-4919-9f1e-fe4a0d8d6afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:47.935324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1000/1984] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:47.936522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd05f7-e8c0-4919-9f1e-fe4a0d8d6afb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.946893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd05f7-e8c0-4919-9f1e-fe4a0d8d6afb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:47.953020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:47.953668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:47.953958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:47.955749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:47.956455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:47.958092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:47.963304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 985/1985] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:47 2022] POST /identity/v3/projects => generated 383 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:47.964144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.971951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1001/1986] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:47.973018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:47.984492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91520ef-830d-4faa-843e-3d15844368ea admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.039930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94309f5-f302-4022-baba-c792714d8f27 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.045677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.046302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.046578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.047021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.047851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.048336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.048524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.048825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.049049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.049681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.051717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.051835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.143149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1002/1987] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:47 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:48.144475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.163969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 986/1988] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:47 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:48.166793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.169467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f634c9-a6ba-4600-aa46-06f6a0e587c9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.249596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:48.290776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.291899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.292422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.292723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] PATH_INFO: `/v3/projects/6d910e1381a2461d854eecf28b02fd63/users/c7436d6fc1bc4508b71058ccfbb4faa1/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.315303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13744b-dcec-4554-985c-40824a7a0bdf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.340456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.341241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.341547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.341828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.342494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.351020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d910e1381a2461d854eecf28b02fd63, user_id=c7436d6fc1bc4508b71058ccfbb4faa1, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.351495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.357202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.376839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 987/1989] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:48.377646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.396046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249a45-fe08-4cb7-9562-b7bbac691f68 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.410458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9479080-67c6-48ad-98a4-97c0db9ca7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.411104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479080-67c6-48ad-98a4-97c0db9ca7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.411398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479080-67c6-48ad-98a4-97c0db9ca7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.411667 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9479080-67c6-48ad-98a4-97c0db9ca7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.418035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9479080-67c6-48ad-98a4-97c0db9ca7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.421229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9479080-67c6-48ad-98a4-97c0db9ca7a8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.459301 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1003/1990] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:48 2022] PUT /identity/v3/projects/6d910e1381a2461d854eecf28b02fd63/users/c7436d6fc1bc4508b71058ccfbb4faa1/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:48.460470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.539165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa241-3e91-48d9-a1c4-b770a0885607 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.544563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.545245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.545528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.545801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] PATH_INFO: `/v3/projects/c543d52ca47d4561bf6ce39db9cf53c8/users/53d87bb24aa04de090fdb7dfe9fcdc0c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.557645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 988/1991] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:48 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:48.564435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac785e-4511-45a2-86dd-545341e79969 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.564435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac785e-4511-45a2-86dd-545341e79969 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.564435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac785e-4511-45a2-86dd-545341e79969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.564739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c543d52ca47d4561bf6ce39db9cf53c8, user_id=53d87bb24aa04de090fdb7dfe9fcdc0c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.568836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.596613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-93ac785e-4511-45a2-86dd-545341e79969 None None] MFA Rules not processed for user `c7436d6fc1bc4508b71058ccfbb4faa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:48.597827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-93ac785e-4511-45a2-86dd-545341e79969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:48.624630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1004/1992] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:48 2022] PUT /identity/v3/projects/c543d52ca47d4561bf6ce39db9cf53c8/users/53d87bb24aa04de090fdb7dfe9fcdc0c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:48.625842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.640292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:48.686250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 989/1993] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:48.687341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac785e-4511-45a2-86dd-545341e79969 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.699295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac785e-4511-45a2-86dd-545341e79969 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.710489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c490ca-89e1-4774-90a1-7476c1c55ba9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.717012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.717924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.718211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.718488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.719735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.720891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.734214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1005/1994] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:48.735052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.745566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9d6e6-da52-4a42-9f0b-6edd8ace4692 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.755704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.756362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.756670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.757191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.757829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.760136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.777421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.778609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.778908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.779191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.782094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.782094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.793008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 990/1995] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:48.794950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.807145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de72d1-e2d0-473d-a7f3-0e01b46217ca admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:48.819231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:48.819231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:48.819231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:48.819231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] PATH_INFO: `/v3/projects/413bbdedb3b94a6da5a3803cf268a8db/users/c327294054344eafab45fa7adba616ff/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:48.826879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:48.834658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413bbdedb3b94a6da5a3803cf268a8db, user_id=c327294054344eafab45fa7adba616ff, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:48.837032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:48.856454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1006/1996] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:48 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:48.857362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.946834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 991/1997] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:48 2022] PUT /identity/v3/projects/413bbdedb3b94a6da5a3803cf268a8db/users/c327294054344eafab45fa7adba616ff/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:48.947917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:48.977533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ace5-3631-4850-99da-f57b2e50fde6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.079798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.081009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.081530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.082097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] PATH_INFO: `/v3/projects/c543d52ca47d4561bf6ce39db9cf53c8/users/53d87bb24aa04de090fdb7dfe9fcdc0c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.082852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043567-e470-48eb-b609-15abe378a877 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.084909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c543d52ca47d4561bf6ce39db9cf53c8, user_id=53d87bb24aa04de090fdb7dfe9fcdc0c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.087813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.090158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5562544-7b14-43a3-a9e8-2d1cc8194d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.092859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5562544-7b14-43a3-a9e8-2d1cc8194d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.093091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5562544-7b14-43a3-a9e8-2d1cc8194d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.093367 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5562544-7b14-43a3-a9e8-2d1cc8194d59 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.094907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5562544-7b14-43a3-a9e8-2d1cc8194d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.097916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5562544-7b14-43a3-a9e8-2d1cc8194d59 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.102613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1007/1998] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:48 2022] PUT /identity/v3/projects/c543d52ca47d4561bf6ce39db9cf53c8/users/53d87bb24aa04de090fdb7dfe9fcdc0c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:49.104340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.169863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.205376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c94b0-5917-4dbc-823f-40b2dedd65f8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.213241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.213241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.213241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.213241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.213584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.214232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.218047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 992/1999] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:48 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:49.219574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc3ea-4ce4-462d-b75a-241ef9b17974 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.219907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc3ea-4ce4-462d-b75a-241ef9b17974 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.220180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc3ea-4ce4-462d-b75a-241ef9b17974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.229492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1008/2000] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:49.230492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.238225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.243698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8abdb3-c77d-4257-a1c5-2b6cc80a5d24 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.249140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.249779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.250064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.250341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.251039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.252747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.256359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cd1fc3ea-4ce4-462d-b75a-241ef9b17974 None None] MFA Rules not processed for user `53d87bb24aa04de090fdb7dfe9fcdc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:49.257616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cd1fc3ea-4ce4-462d-b75a-241ef9b17974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:49.273449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1009/2001] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:49.273449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.286461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26e975-0f2f-472a-aac9-70d5c709957d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.292148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.295469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.295879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.296509 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] PATH_INFO: `/v3/projects/413bbdedb3b94a6da5a3803cf268a8db/users/c327294054344eafab45fa7adba616ff/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.299283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413bbdedb3b94a6da5a3803cf268a8db, user_id=c327294054344eafab45fa7adba616ff, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.302351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.325002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1010/2002] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:49 2022] PUT /identity/v3/projects/413bbdedb3b94a6da5a3803cf268a8db/users/c327294054344eafab45fa7adba616ff/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:49.325002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.370101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 993/2003] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:49.371660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048919d-6cb4-4b4c-a93f-bfe24a1f46f9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.371937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048919d-6cb4-4b4c-a93f-bfe24a1f46f9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.372237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048919d-6cb4-4b4c-a93f-bfe24a1f46f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.399849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939b357-cdba-4dac-8ac4-c8ddb77a35e6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.400235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1048919d-6cb4-4b4c-a93f-bfe24a1f46f9 None None] MFA Rules not processed for user `c327294054344eafab45fa7adba616ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:49.401592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1048919d-6cb4-4b4c-a93f-bfe24a1f46f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:49.405386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.406058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.406345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.406627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] PATH_INFO: `/v3/projects/89047ec6081249358c5c1d10ad5a0157/users/43c295db99c44a28994e88348da1d9a0/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.421494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] RBAC: Authorizing `identity:create_grant(project_id=89047ec6081249358c5c1d10ad5a0157, user_id=43c295db99c44a28994e88348da1d9a0, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.424171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.444242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.473781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 994/2004] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:49.474672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048919d-6cb4-4b4c-a93f-bfe24a1f46f9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.507569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1011/2005] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:49 2022] PUT /identity/v3/projects/89047ec6081249358c5c1d10ad5a0157/users/43c295db99c44a28994e88348da1d9a0/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:49.511292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.524541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.537215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048919d-6cb4-4b4c-a93f-bfe24a1f46f9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.582731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344a1da-cacb-4314-a901-989897d307db admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.587620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.588258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.588536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.588814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.589504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.592418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.600334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.600981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.601454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.602326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.603349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1012/2006] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:29:49.604279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.606360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:49.619554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f636dc-0951-4996-b70d-aee5ee011780 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.623688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc792f3b-4241-4969-b8b7-83ecd52199a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.624387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc792f3b-4241-4969-b8b7-83ecd52199a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.624669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc792f3b-4241-4969-b8b7-83ecd52199a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.624941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc792f3b-4241-4969-b8b7-83ecd52199a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.626793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fc792f3b-4241-4969-b8b7-83ecd52199a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:49.662675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.690241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.693305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.700285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.705911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc792f3b-4241-4969-b8b7-83ecd52199a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.708269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 995/2007] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:49.708564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc792f3b-4241-4969-b8b7-83ecd52199a2 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.717730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:49.730398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3e7a6-f62b-44e6-b397-d10e5d9536a6 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:49.735623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1013/2008] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:49.739502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:49.740476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.740476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.740768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] PATH_INFO: `/v3/projects/89047ec6081249358c5c1d10ad5a0157/users/43c295db99c44a28994e88348da1d9a0/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.743449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=89047ec6081249358c5c1d10ad5a0157, user_id=43c295db99c44a28994e88348da1d9a0, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:49.746318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:49.767162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 996/2009] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:49 2022] PUT /identity/v3/projects/89047ec6081249358c5c1d10ad5a0157/users/43c295db99c44a28994e88348da1d9a0/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:49.778009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f27e-3947-4ee5-aae0-528f4ec06157 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:49.779309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f27e-3947-4ee5-aae0-528f4ec06157 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:49.779663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751f27e-3947-4ee5-aae0-528f4ec06157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:49.784073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.804947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.813591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0751f27e-3947-4ee5-aae0-528f4ec06157 None None] MFA Rules not processed for user `43c295db99c44a28994e88348da1d9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:49.814815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0751f27e-3947-4ee5-aae0-528f4ec06157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:49.891165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1014/2010] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:50.395380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:50.423986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:50.482528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ec35d-116c-45ec-abcc-230addd2d5ae admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:50.486110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:50.486702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:50.486984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:50.487260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:50.496385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:50.498171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:50.507579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 997/2011] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:50.903543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751f27e-3947-4ee5-aae0-528f4ec06157 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:50.917252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751f27e-3947-4ee5-aae0-528f4ec06157 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:50.922341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0802ff-3ecc-4235-82ef-8b1296b4ab93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:50.922956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0802ff-3ecc-4235-82ef-8b1296b4ab93 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:50.923255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0802ff-3ecc-4235-82ef-8b1296b4ab93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:50.923505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0802ff-3ecc-4235-82ef-8b1296b4ab93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:50.957820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:50.984232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0802ff-3ecc-4235-82ef-8b1296b4ab93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:50.985606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0802ff-3ecc-4235-82ef-8b1296b4ab93 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:50.995603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1015/2012] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:51.532307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:51.789786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:51.870766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a174d1-d62c-48db-9f1f-4387b5c2d730 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:51.876746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:51.877701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:51.877952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:51.878379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] PATH_INFO: `/v3/users/c7436d6fc1bc4508b71058ccfbb4faa1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:51.880383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7436d6fc1bc4508b71058ccfbb4faa1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:51.882675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:51.909419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:52.106529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7436d6fc1bc4508b71058ccfbb4faa1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.107468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7436d6fc1bc4508b71058ccfbb4faa1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.129746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7436d6fc1bc4508b71058ccfbb4faa1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.139497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7436d6fc1bc4508b71058ccfbb4faa1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.140231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7436d6fc1bc4508b71058ccfbb4faa1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.239203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 998/2013] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:51 2022] DELETE /identity/v3/users/c7436d6fc1bc4508b71058ccfbb4faa1 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:52.246403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:52.246700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:52.246980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:52.268156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:52.273192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:52.314472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:52.316097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:52.349693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1016/2014] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:52.361815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:52.363357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:52.388759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:52.400642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba0cdf-8f10-4b8a-b216-93bc210e1692 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:52.406709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:52.410335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:52.410335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:52.410335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] PATH_INFO: `/v3/users/1f3f08a29d1b4f1cb42e830771ea60b5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:52.410335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3f08a29d1b4f1cb42e830771ea60b5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:52.411042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:52.429829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf107-6ecc-41f2-8427-164dd6d53dba None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:52.433664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22764f2-df77-46a7-84d6-6af18dbea4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:52.434648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22764f2-df77-46a7-84d6-6af18dbea4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:52.441309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22764f2-df77-46a7-84d6-6af18dbea4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:52.441309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22764f2-df77-46a7-84d6-6af18dbea4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:52.444768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22764f2-df77-46a7-84d6-6af18dbea4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:52.446206 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22764f2-df77-46a7-84d6-6af18dbea4c7 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:52.456045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1017/2015] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:52.634997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3f08a29d1b4f1cb42e830771ea60b5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.635752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3f08a29d1b4f1cb42e830771ea60b5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.652351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3f08a29d1b4f1cb42e830771ea60b5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.660809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3f08a29d1b4f1cb42e830771ea60b5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.661386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3f08a29d1b4f1cb42e830771ea60b5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:52.759899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 999/2016] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:52 2022] DELETE /identity/v3/users/1f3f08a29d1b4f1cb42e830771ea60b5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:52.767297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:52.767856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:52.768518 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:52.810065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:52.811559 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:52.889116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1018/2017] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:52.898248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:52.900408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:52.948978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:52.951340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:52.969548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcd8b0-2c9d-41d1-aba3-b5f250265158 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:52.973458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:52.974369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:52.974481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:52.974714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:52.978854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48143-92a8-4607-a740-cf90b1acdce6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:52.986044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:52.989207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:52.990717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:52.993175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:52.993943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:52.994314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:52.994595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] PATH_INFO: `/v3/projects/6d910e1381a2461d854eecf28b02fd63` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:52.995727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d910e1381a2461d854eecf28b02fd63)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:52.998635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:53.003216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1000/2018] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:53.098968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d910e1381a2461d854eecf28b02fd63', 'request_id': 'req-e6900b98-8efa-4c0d-bed9-5fc422fd98de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.105022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d910e1381a2461d854eecf28b02fd63', 'request_id': 'req-e6900b98-8efa-4c0d-bed9-5fc422fd98de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.181533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d910e1381a2461d854eecf28b02fd63', 'request_id': 'req-e6900b98-8efa-4c0d-bed9-5fc422fd98de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.201057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] The token cache is being invalidate because project 6d910e1381a2461d854eecf28b02fd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:53.201788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.202803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.208698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1019/2019] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:52 2022] DELETE /identity/v3/projects/6d910e1381a2461d854eecf28b02fd63 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:53.209596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:53.219729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d544d-227e-4f88-94e0-a157f096e2ad service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:53.289046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:53.289688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:53.289969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:53.290242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] PATH_INFO: `/v3/users/43c295db99c44a28994e88348da1d9a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:53.291367 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c295db99c44a28994e88348da1d9a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:53.293917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:53.516911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:53.518511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:53.539282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c295db99c44a28994e88348da1d9a0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.539960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c295db99c44a28994e88348da1d9a0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.555089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c295db99c44a28994e88348da1d9a0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.563547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c295db99c44a28994e88348da1d9a0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.564333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c295db99c44a28994e88348da1d9a0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:53.587120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:53.605493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6900b98-8efa-4c0d-bed9-5fc422fd98de admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:53.622428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:53.622428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:53.622428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:53.622428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:53.623242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:53.679855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1001/2020] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:53 2022] DELETE /identity/v3/users/43c295db99c44a28994e88348da1d9a0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:53.680928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:53.682360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:53.693848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:53.695635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:53.709555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1020/2021] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:53.795015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf6ec1-4ed6-40d3-8270-c42ae04da450 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:53.802920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:53.803271 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:53.803557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:53.803837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] PATH_INFO: `/v3/projects/019dd635db0942d49fc584ac37e9210f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:53.805080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019dd635db0942d49fc584ac37e9210f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:53.807121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:54.005576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019dd635db0942d49fc584ac37e9210f', 'request_id': 'req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.020602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019dd635db0942d49fc584ac37e9210f', 'request_id': 'req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.030153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019dd635db0942d49fc584ac37e9210f', 'request_id': 'req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.130039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] The token cache is being invalidate because project 019dd635db0942d49fc584ac37e9210f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:54.130225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.131068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.133817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1002/2022] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:53 2022] DELETE /identity/v3/projects/019dd635db0942d49fc584ac37e9210f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:54.138525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:54.154937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfaeaa-d17c-4257-82cd-dbaad7432dd0 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:54.192929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:54.252867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:54.253583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:54.253873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:54.254151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] PATH_INFO: `/v3/users/667fe5fbb53541658db9496c71d5e16a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:54.255714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667fe5fbb53541658db9496c71d5e16a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:54.259870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:54.434943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667fe5fbb53541658db9496c71d5e16a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.436036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667fe5fbb53541658db9496c71d5e16a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.452155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:54.453751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:54.459843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667fe5fbb53541658db9496c71d5e16a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.460730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667fe5fbb53541658db9496c71d5e16a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.471619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7c5e8-a102-4e3b-b45a-9ed8ddddca73 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:54.478415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:54.479265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:54.479559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:54.479842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] PATH_INFO: `/v3/projects/89047ec6081249358c5c1d10ad5a0157` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:54.481301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89047ec6081249358c5c1d10ad5a0157)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:54.483761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:54.535517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b2f7ebf-5a2f-458d-a5bc-d2b491661122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667fe5fbb53541658db9496c71d5e16a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.549730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1021/2023] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:54 2022] DELETE /identity/v3/users/667fe5fbb53541658db9496c71d5e16a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:54.587530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89047ec6081249358c5c1d10ad5a0157', 'request_id': 'req-8ebe7227-84ff-4093-83d0-2899f8f598e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.596595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89047ec6081249358c5c1d10ad5a0157', 'request_id': 'req-8ebe7227-84ff-4093-83d0-2899f8f598e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.604360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89047ec6081249358c5c1d10ad5a0157', 'request_id': 'req-8ebe7227-84ff-4093-83d0-2899f8f598e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.718427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] The token cache is being invalidate because project 89047ec6081249358c5c1d10ad5a0157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:54.720010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.720010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ebe7227-84ff-4093-83d0-2899f8f598e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:54.721346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1003/2024] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:54 2022] DELETE /identity/v3/projects/89047ec6081249358c5c1d10ad5a0157 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:54.727211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927b50-bee6-4b7e-88e5-d77db3fac787 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:54.727572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927b50-bee6-4b7e-88e5-d77db3fac787 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:54.727851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76927b50-bee6-4b7e-88e5-d77db3fac787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:54.751603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-76927b50-bee6-4b7e-88e5-d77db3fac787 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:54.752912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-76927b50-bee6-4b7e-88e5-d77db3fac787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:54.768046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:54.820724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1022/2025] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:54.829284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b222b-be7b-49f4-bc4e-37db8c02679e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:54.829494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b222b-be7b-49f4-bc4e-37db8c02679e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:54.829826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b222b-be7b-49f4-bc4e-37db8c02679e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:54.856006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fa1b222b-be7b-49f4-bc4e-37db8c02679e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:54.857787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fa1b222b-be7b-49f4-bc4e-37db8c02679e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:54.867038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1004/2026] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:54.872133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76927b50-bee6-4b7e-88e5-d77db3fac787 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:54.886808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76927b50-bee6-4b7e-88e5-d77db3fac787 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:54.894943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:54.896246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:54.896687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:54.897111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:54.897959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:54.898745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:54.900936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:54.923676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1023/2027] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:54.924905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b222b-be7b-49f4-bc4e-37db8c02679e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:54.942032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b222b-be7b-49f4-bc4e-37db8c02679e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:54.947870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:54.949079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:54.950674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:54.951240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:54.952182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:54.955154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.156952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1005/2028] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:54 2022] POST /identity/v3/projects => generated 359 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:55.160725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:55.174310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f025ee7-497d-433f-af5a-19a275e69791 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:55.215743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:55.217698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:55.286470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:55.291831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.291831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.291831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.291831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:55.291831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.330365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe846408-f5d3-4562-95e7-058c0910f23d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:55.335239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:55.335874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.336153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.336457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] PATH_INFO: `/v3/projects/385bf094388842c2b8437b03b40653b9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.337705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385bf094388842c2b8437b03b40653b9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:55.339641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.401649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:55.409443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1024/2029] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:55 2022] POST /identity/v3/users => generated 280 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:55.413285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:55.450517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64786c5-a7ae-48a4-99f4-b0b2777505cc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:55.454401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385bf094388842c2b8437b03b40653b9', 'request_id': 'req-63dbbd76-01ca-47c4-b160-1312d7a27e07'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.469725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385bf094388842c2b8437b03b40653b9', 'request_id': 'req-63dbbd76-01ca-47c4-b160-1312d7a27e07'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.475989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385bf094388842c2b8437b03b40653b9', 'request_id': 'req-63dbbd76-01ca-47c4-b160-1312d7a27e07'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.530332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:55.531205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.531597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.531970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.532803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:55.534662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.546833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1025/2030] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:55.547925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:55.554485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] The token cache is being invalidate because project 385bf094388842c2b8437b03b40653b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:55.554786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.555575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.557529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1006/2031] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:55 2022] DELETE /identity/v3/projects/385bf094388842c2b8437b03b40653b9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:55.558298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:55.562494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:55.562639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:55.579457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590b1f8-8245-4729-9a60-ea168ead9bd5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:55.585600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:55.586649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.586940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.587225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] PATH_INFO: `/v3/users/bc2761b0688144a38567063bd637fd89` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.588402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbbd76-01ca-47c4-b160-1312d7a27e07 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:55.588697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2761b0688144a38567063bd637fd89)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:55.591633 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.593983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d4250-b899-41d6-8b93-fe4dc67eeba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:55.594688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4250-b899-41d6-8b93-fe4dc67eeba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.595039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4250-b899-41d6-8b93-fe4dc67eeba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.595382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4250-b899-41d6-8b93-fe4dc67eeba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.596170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d4250-b899-41d6-8b93-fe4dc67eeba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:55.598033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d4250-b899-41d6-8b93-fe4dc67eeba2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.609819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1007/2032] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:55.611132 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.611418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.611693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.632567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:55.633784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:55.642956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1008/2033] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:55.644956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:55.646370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:55.712930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00fba-df0e-400f-b2a1-e104a4b63197 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:55.718952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:55.719611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.719895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.720173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.722096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:55.764188 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2761b0688144a38567063bd637fd89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.764946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2761b0688144a38567063bd637fd89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.778655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2761b0688144a38567063bd637fd89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.779411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2761b0688144a38567063bd637fd89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.803480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:55.805071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.816296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1009/2034] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:55.816966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:55.828136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346ba26-a0d0-4bba-8e21-ad7cb70f5f98 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:55.833753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002119-7ecb-4604-a69e-9e824e88c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:55.834496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002119-7ecb-4604-a69e-9e824e88c1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.834884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002119-7ecb-4604-a69e-9e824e88c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.835228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002119-7ecb-4604-a69e-9e824e88c1d7 admin admin] PATH_INFO: `/v3/projects/c67d1148abf74177b13540b2249ca511/users/975ae0ecbe9c4252be3125a718204aba/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.839597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e0866bc-9686-4ccf-adff-baa3b46663a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2761b0688144a38567063bd637fd89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:55.855111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002119-7ecb-4604-a69e-9e824e88c1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67d1148abf74177b13540b2249ca511, user_id=975ae0ecbe9c4252be3125a718204aba, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:55.859703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002119-7ecb-4604-a69e-9e824e88c1d7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:55.861183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1026/2035] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:55 2022] DELETE /identity/v3/users/bc2761b0688144a38567063bd637fd89 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:55.862558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d55d-7e92-4fc1-af0e-4bfb1ef34b6f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.863071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d55d-7e92-4fc1-af0e-4bfb1ef34b6f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.863558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d55d-7e92-4fc1-af0e-4bfb1ef34b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.869710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:55.891638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9387d55d-7e92-4fc1-af0e-4bfb1ef34b6f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:55.893144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9387d55d-7e92-4fc1-af0e-4bfb1ef34b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:55.956585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1010/2036] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:55 2022] PUT /identity/v3/projects/c67d1148abf74177b13540b2249ca511/users/975ae0ecbe9c4252be3125a718204aba/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:55.966226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8a829-486e-444a-8c85-b2326d515f45 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.967902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8a829-486e-444a-8c85-b2326d515f45 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.968438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8a829-486e-444a-8c85-b2326d515f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.976635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1027/2037] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:55.976635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:55.976635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:55.976635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:55.992062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ebe8a829-486e-444a-8c85-b2326d515f45 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:55.993413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ebe8a829-486e-444a-8c85-b2326d515f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:56.004033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] MFA Rules not processed for user `975ae0ecbe9c4252be3125a718204aba`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:56.005240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:56.072772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1011/2038] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:56.074273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8a829-486e-444a-8c85-b2326d515f45 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.090325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8a829-486e-444a-8c85-b2326d515f45 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.096141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.097007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.097442 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.097942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.098764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:56.099233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.101057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.115446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1028/2039] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:56.115446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.115446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:56.126108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1012/2040] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:56.145503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.160052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afae18-ef10-478c-9081-d06883b28f48 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.168424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.169074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.169353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.169632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.170309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.172467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.194637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae77dd0-a53f-4df8-afac-6a721ec412b5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.198667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.199370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.199681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.200021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.228246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.232167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.243805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1029/2041] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:56.244706 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.246211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:56.304017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1013/2042] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:56 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:56.308286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.348205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251fe4b-8b79-4df7-9ba1-c1c32eb0a32e service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.398325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49df2-6bd1-427e-858f-e17eb69a7489 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.406097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.406843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.407191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.407526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.408182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.410255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.411889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.412554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.412848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.413136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.454362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:56.475185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.477170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.487278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1030/2043] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:56.504308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.505860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:56.523474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd725ad-f82d-4ba7-a9bd-d1cec44092bd service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.533646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1014/2044] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:56 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:56.534745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.546659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219a1d-a7f5-4511-a44e-0a4627ef2239 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.547410 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.548413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.549240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.549747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] PATH_INFO: `/v3/users/975ae0ecbe9c4252be3125a718204aba` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.551682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975ae0ecbe9c4252be3125a718204aba)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.552337 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.553117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.553488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.553869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.554753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.555220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.556548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.571543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1015/2045] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:56.572640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.585331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad09c2-2544-4e27-b462-2c0c24d11622 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.592600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.593402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.594144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.594144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.594738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.596643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.608067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1016/2046] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:29:56.613235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.623329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154d26-5725-4fff-b406-fc71a5f04080 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.628631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.629297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.629605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.630326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] PATH_INFO: `/v3/projects/2935815e2b994c959973822916c4178b/users/8c5e93349d954a27a1dac0188ad10acb/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.645780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2935815e2b994c959973822916c4178b, user_id=8c5e93349d954a27a1dac0188ad10acb, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.650796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.709596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1017/2047] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:56 2022] PUT /identity/v3/projects/2935815e2b994c959973822916c4178b/users/8c5e93349d954a27a1dac0188ad10acb/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:56.710340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:56.719228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:56.787954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf9cb4-ba0b-428e-a335-208d7259422f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:56.792857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:56.793445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.793777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.794039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] PATH_INFO: `/v3/projects/51c40b72a93444a39a90153cd1023023` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.795154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c40b72a93444a39a90153cd1023023)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:56.797102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:56.805320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975ae0ecbe9c4252be3125a718204aba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:56.805988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975ae0ecbe9c4252be3125a718204aba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:56.825605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975ae0ecbe9c4252be3125a718204aba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:56.826588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975ae0ecbe9c4252be3125a718204aba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:56.964068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-73d2d4d8-b652-49c4-892f-f8d3236f7a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975ae0ecbe9c4252be3125a718204aba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:56.978597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1031/2048] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:56 2022] DELETE /identity/v3/users/975ae0ecbe9c4252be3125a718204aba => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:56.980305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663cbcd-06a8-46c9-a6e0-4130237e3e2a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:56.980305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663cbcd-06a8-46c9-a6e0-4130237e3e2a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:56.980650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663cbcd-06a8-46c9-a6e0-4130237e3e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:56.998043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c40b72a93444a39a90153cd1023023', 'request_id': 'req-792f53d8-3eb3-41e2-8237-dff56bef7919'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.015320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c40b72a93444a39a90153cd1023023', 'request_id': 'req-792f53d8-3eb3-41e2-8237-dff56bef7919'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.016639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4663cbcd-06a8-46c9-a6e0-4130237e3e2a None None] MFA Rules not processed for user `8c5e93349d954a27a1dac0188ad10acb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:57.018030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4663cbcd-06a8-46c9-a6e0-4130237e3e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:57.022096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c40b72a93444a39a90153cd1023023', 'request_id': 'req-792f53d8-3eb3-41e2-8237-dff56bef7919'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.092186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1032/2049] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:57.093640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.093931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.094204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.120165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:57.122319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:57.138733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] The token cache is being invalidate because project 51c40b72a93444a39a90153cd1023023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:57.139261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.140156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.141927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1018/2050] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:56 2022] DELETE /identity/v3/projects/51c40b72a93444a39a90153cd1023023 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:57.142877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:57.144437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:57.204486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1033/2051] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:57.205685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:57.207438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:57.226849 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836110d-fdf4-48ed-8a7f-7fec40bedfac None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:57.233911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:57.234357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.234639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.235065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] PATH_INFO: `/v3/users/53d87bb24aa04de090fdb7dfe9fcdc0c` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.236339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d87bb24aa04de090fdb7dfe9fcdc0c)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:57.241421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:57.243825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f53d8-3eb3-41e2-8237-dff56bef7919 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:57.250956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:57.251582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.252585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.252883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.254139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:57.257599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:57.373458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1019/2052] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:57 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:57.373458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:57.373458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:57.430743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea47b5-15b6-4721-8637-25c7984e9322 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:57.435641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:57.436289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.436616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.436956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.441159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d87bb24aa04de090fdb7dfe9fcdc0c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.441825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d87bb24aa04de090fdb7dfe9fcdc0c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.454025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d87bb24aa04de090fdb7dfe9fcdc0c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.454700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d87bb24aa04de090fdb7dfe9fcdc0c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.500371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:57.501739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:57.511513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1020/2053] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:57.512399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d87bb24aa04de090fdb7dfe9fcdc0c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:57.512727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:57.522313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d8b0-77f1-45f5-8cff-00b29e22ca9b service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:57.526005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1034/2054] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:29:57 2022] DELETE /identity/v3/users/53d87bb24aa04de090fdb7dfe9fcdc0c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:57.528201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:57.529013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.529301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.536610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.537518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:57.539740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:57.569903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:57.661356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1021/2055] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:57 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:57.665482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:57.666968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:57.740605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dae49-573e-42b8-b994-711c4c15d738 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:57.745741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:57.747019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.747656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.747868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.748856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:57.750585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:57.765545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1035/2056] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:57.767436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:57.786849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e77d97-b596-492b-b005-781ec7af92bf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:57.791742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:57.792446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.792729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.793549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] PATH_INFO: `/v3/projects/1261923f7b64465aa9c6277c8f46686a/users/345bbca2067a448caf9e348ce6d378e6/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.811181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1261923f7b64465aa9c6277c8f46686a, user_id=345bbca2067a448caf9e348ce6d378e6, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:57.815213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:57.905538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1022/2057] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:57 2022] PUT /identity/v3/projects/1261923f7b64465aa9c6277c8f46686a/users/345bbca2067a448caf9e348ce6d378e6/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:57.909742 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:57.925010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847356bc-eacc-45eb-8ff5-6129a3388b0e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:57.987625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:57.988284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:57.988574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:57.988889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:57.989580 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:57.991215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.002299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1036/2058] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:58.006391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.017491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67736bc-da7e-4250-98f9-2dd007eb1ed5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.022180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcec1b-10eb-420f-9425-cb2b5e06ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.022841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcec1b-10eb-420f-9425-cb2b5e06ec15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.023131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcec1b-10eb-420f-9425-cb2b5e06ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.023403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcec1b-10eb-420f-9425-cb2b5e06ec15 admin admin] PATH_INFO: `/v3/projects/1261923f7b64465aa9c6277c8f46686a/users/345bbca2067a448caf9e348ce6d378e6/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.025498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcec1b-10eb-420f-9425-cb2b5e06ec15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1261923f7b64465aa9c6277c8f46686a, user_id=345bbca2067a448caf9e348ce6d378e6, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.029203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcec1b-10eb-420f-9425-cb2b5e06ec15 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.039957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.041888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.042772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1023/2059] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:58 2022] PUT /identity/v3/projects/1261923f7b64465aa9c6277c8f46686a/users/345bbca2067a448caf9e348ce6d378e6/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:58.061932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.061932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.061932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.065811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b494aa-ac84-41cf-8dc5-457a21ea7584 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.095948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] MFA Rules not processed for user `345bbca2067a448caf9e348ce6d378e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:58.097237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.129590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:58.138063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.138720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.139001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.139297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] PATH_INFO: `/v3/projects/c67d1148abf74177b13540b2249ca511` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.140477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67d1148abf74177b13540b2249ca511)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.142405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.192689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1024/2060] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:58.194519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.196583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.212102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90813bc-1dac-4c45-9813-b5533f8175cc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.221870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.222901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.223530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.223956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] PATH_INFO: `/v3/projects/c543d52ca47d4561bf6ce39db9cf53c8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.226895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c543d52ca47d4561bf6ce39db9cf53c8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.228979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.244993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67d1148abf74177b13540b2249ca511', 'request_id': 'req-5098ad60-ff83-4a89-a042-a8330f7fd3e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.252383 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67d1148abf74177b13540b2249ca511', 'request_id': 'req-5098ad60-ff83-4a89-a042-a8330f7fd3e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.331764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67d1148abf74177b13540b2249ca511', 'request_id': 'req-5098ad60-ff83-4a89-a042-a8330f7fd3e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.344035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] The token cache is being invalidate because project c67d1148abf74177b13540b2249ca511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:58.344482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.345141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.349876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1037/2061] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:58 2022] DELETE /identity/v3/projects/c67d1148abf74177b13540b2249ca511 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:58.349876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.352560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.371159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c543d52ca47d4561bf6ce39db9cf53c8', 'request_id': 'req-d8847bd5-2674-41b6-9017-0776ac0d5b0a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.377655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c543d52ca47d4561bf6ce39db9cf53c8', 'request_id': 'req-d8847bd5-2674-41b6-9017-0776ac0d5b0a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.384473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c543d52ca47d4561bf6ce39db9cf53c8', 'request_id': 'req-d8847bd5-2674-41b6-9017-0776ac0d5b0a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.421767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098ad60-ff83-4a89-a042-a8330f7fd3e6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.466952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] The token cache is being invalidate because project c543d52ca47d4561bf6ce39db9cf53c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:29:58.469207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.469207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8847bd5-2674-41b6-9017-0776ac0d5b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:29:58.470942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1025/2062] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:29:58 2022] DELETE /identity/v3/projects/c543d52ca47d4561bf6ce39db9cf53c8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:58.472433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645b6e-79bd-43ff-babd-23a01fe38c18 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.472719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645b6e-79bd-43ff-babd-23a01fe38c18 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.472996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645b6e-79bd-43ff-babd-23a01fe38c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.474711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9f586-2c53-4951-85f6-b536ad7a2da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.475337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9f586-2c53-4951-85f6-b536ad7a2da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.475616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9f586-2c53-4951-85f6-b536ad7a2da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.475895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9f586-2c53-4951-85f6-b536ad7a2da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.477786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-48e9f586-2c53-4951-85f6-b536ad7a2da2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.490374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:58.494595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-33645b6e-79bd-43ff-babd-23a01fe38c18 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:58.495783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-33645b6e-79bd-43ff-babd-23a01fe38c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.540508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9f586-2c53-4951-85f6-b536ad7a2da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.541934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9f586-2c53-4951-85f6-b536ad7a2da2 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.552114 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1038/2063] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:58.553463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538eb08-656d-4662-abdc-9e9598c7817c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.553809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538eb08-656d-4662-abdc-9e9598c7817c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.554024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538eb08-656d-4662-abdc-9e9598c7817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.561978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1026/2064] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:58.565199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7373-22e5-4f11-9bc7-a27de71e13f6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.565494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7373-22e5-4f11-9bc7-a27de71e13f6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.565782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb7373-22e5-4f11-9bc7-a27de71e13f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.582365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f538eb08-656d-4662-abdc-9e9598c7817c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:58.583579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f538eb08-656d-4662-abdc-9e9598c7817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.589166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-04bb7373-22e5-4f11-9bc7-a27de71e13f6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:58.591052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-04bb7373-22e5-4f11-9bc7-a27de71e13f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.593072 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1039/2065] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:58.599704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1027/2066] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:58.600446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d34a8-d28e-4353-a6a7-792fc671a2e8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.600733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d34a8-d28e-4353-a6a7-792fc671a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.601009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d34a8-d28e-4353-a6a7-792fc671a2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.603853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7373-22e5-4f11-9bc7-a27de71e13f6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.613883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb7373-22e5-4f11-9bc7-a27de71e13f6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.618831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.620672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.620672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.620672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.620672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:58.620977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.622697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.626999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a61d34a8-d28e-4353-a6a7-792fc671a2e8 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:58.628386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a61d34a8-d28e-4353-a6a7-792fc671a2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:58.638832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1028/2067] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:58.643173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.645783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1040/2068] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:29:58.651362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d34a8-d28e-4353-a6a7-792fc671a2e8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.659168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaba7-7c40-419b-9e11-cb78713312aa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.662138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d34a8-d28e-4353-a6a7-792fc671a2e8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.665387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.666131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.666552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.666958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.667422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.667608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.668733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.669077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.669482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.670085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:29:58.670391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.670762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.671982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.837540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1041/2069] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:29:58.837540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.837540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9648ba-42d9-4cf9-9460-3e58e5ea9f14 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.837540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.837920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.837920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.837920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.837920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.837920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.838318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:58.869266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1029/2070] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:58.872062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1042/2071] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:58.875655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.876181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:58.942168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fc064-c5aa-40e0-bec5-0ebadafcde1e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.942319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5852c8-9ce3-40a3-95a2-b772b2c411c2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:58.947137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.947725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.947955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:58.948076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.948296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.948643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:58.948928 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:58.949038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.949375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:58.950358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:58.951671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:58.952520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.038778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1030/2072] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:59.039282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1043/2073] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:58 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:59.042939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.043255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.053232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d540f-e765-4573-8069-414bccfd3fc4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.053753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447fae-8c22-4710-b7b1-40ec0ed1233c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.058491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.059266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.059828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.060015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.060118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.060497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.060670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.060778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.061190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.061521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.062795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.063097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.072970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1031/2074] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:59.077215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1044/2075] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:29:59.077970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.078116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.087808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918b4e-b9f9-40fe-8cc0-4c52c7b7ec89 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.087964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd462-37cc-4383-9fcc-c8bd23b30c96 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.092472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.097148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.097295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.097397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.097490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.097601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.097703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.097801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.097896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.097986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.098076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.098167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.107080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1045/2076] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:29:59.108023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1032/2077] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:59.111307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.111811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.121738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dffcd-3360-4350-8ffa-d71786e03cca admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.123761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce3f3-3aea-40e3-a245-97920e8ed29f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.127948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26631d2c-94a9-45e8-86f8-45a0fb23ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.129033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26631d2c-94a9-45e8-86f8-45a0fb23ecc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.129321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26631d2c-94a9-45e8-86f8-45a0fb23ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.129429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8a70-6db2-4f2d-95dd-3b8046bf7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.129594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26631d2c-94a9-45e8-86f8-45a0fb23ecc6 admin admin] PATH_INFO: `/v3/projects/c7049c217d4e4747990915d8f2d78e71/users/c598f3829d364daaa1df5883aec1bb0e/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.130098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8a70-6db2-4f2d-95dd-3b8046bf7663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.130368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8a70-6db2-4f2d-95dd-3b8046bf7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.130644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8a70-6db2-4f2d-95dd-3b8046bf7663 admin admin] PATH_INFO: `/v3/projects/134dd652390444e1ab4bb372d2773ef9/users/aa5a9394fabf47bb8205d46f2a93f300/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.146377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26631d2c-94a9-45e8-86f8-45a0fb23ecc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7049c217d4e4747990915d8f2d78e71, user_id=c598f3829d364daaa1df5883aec1bb0e, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.146639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8a70-6db2-4f2d-95dd-3b8046bf7663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134dd652390444e1ab4bb372d2773ef9, user_id=aa5a9394fabf47bb8205d46f2a93f300, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.149107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26631d2c-94a9-45e8-86f8-45a0fb23ecc6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.149430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8a70-6db2-4f2d-95dd-3b8046bf7663 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.249381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1033/2078] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:59 2022] PUT /identity/v3/projects/134dd652390444e1ab4bb372d2773ef9/users/aa5a9394fabf47bb8205d46f2a93f300/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:59.252334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1046/2079] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:59 2022] PUT /identity/v3/projects/c7049c217d4e4747990915d8f2d78e71/users/c598f3829d364daaa1df5883aec1bb0e/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:59.254239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd0a74-3b98-4361-becd-7be737f9591e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.254528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd0a74-3b98-4361-becd-7be737f9591e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.254804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd0a74-3b98-4361-becd-7be737f9591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.262612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.263124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.263451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.273358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:59.283484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-44fd0a74-3b98-4361-becd-7be737f9591e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:59.283484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-44fd0a74-3b98-4361-becd-7be737f9591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:59.295218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] MFA Rules not processed for user `c598f3829d364daaa1df5883aec1bb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:29:59.296475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:59.362218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1034/2080] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:59.371850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1047/2081] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:29:59.376773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd0a74-3b98-4361-becd-7be737f9591e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.380610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.382088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:29:59.387964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd0a74-3b98-4361-becd-7be737f9591e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.393188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.393808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.394098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.394375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.395023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.397291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.476471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1035/2082] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:29:59 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:29:59.481201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.560023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b07e6-fcfc-4a67-b902-a21922c5fdc7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.566393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.567270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.567719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.568156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.568966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.572691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.577135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ef20-58fe-460c-b9ef-3c7e6cbe8bff None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.627713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.628358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.628643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.628920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.639395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.640904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.650343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1048/2083] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:29:59.682799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1036/2084] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:29:59 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:29:59.687420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.697196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8b8cd-58c6-4808-b238-057c1c7bae3a service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.702250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.702839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.703134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.703387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.704089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.705698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.719273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1049/2085] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:59.720550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.741864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2eef-5713-46fd-bf69-6919a81a6ea8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.741864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.741864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.741864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.742572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] PATH_INFO: `/v3/projects/4318a31f4ef64c458d7f3d3d5568382f/users/8b0e4c4605144d6c92ece3380959f1de/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.762843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4318a31f4ef64c458d7f3d3d5568382f, user_id=8b0e4c4605144d6c92ece3380959f1de, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.766392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.793297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:59.817875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1037/2086] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:59 2022] PUT /identity/v3/projects/4318a31f4ef64c458d7f3d3d5568382f/users/8b0e4c4605144d6c92ece3380959f1de/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:29:59.822025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.839108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd6fed-5473-4db6-a535-fc1d32b4db1f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.900535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a44c0-6143-43b9-96aa-d682356a961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.901147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a44c0-6143-43b9-96aa-d682356a961d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.901430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a44c0-6143-43b9-96aa-d682356a961d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.901703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a44c0-6143-43b9-96aa-d682356a961d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.902961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a44c0-6143-43b9-96aa-d682356a961d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.904829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a44c0-6143-43b9-96aa-d682356a961d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.921173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:29:59.921621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1050/2087] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:29:59.933125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddc0cd-ad48-4e0e-8f73-043f511cba6c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:29:59.938379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:29:59.940603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.940603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.940603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] PATH_INFO: `/v3/projects/4318a31f4ef64c458d7f3d3d5568382f/users/8b0e4c4605144d6c92ece3380959f1de/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:29:59.941725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4318a31f4ef64c458d7f3d3d5568382f, user_id=8b0e4c4605144d6c92ece3380959f1de, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:29:59.944419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:29:59.960547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1038/2088] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:29:59 2022] PUT /identity/v3/projects/4318a31f4ef64c458d7f3d3d5568382f/users/8b0e4c4605144d6c92ece3380959f1de/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:29:59.967291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47334e-4b28-4184-822d-9b6051c0dbbb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:29:59.969692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47334e-4b28-4184-822d-9b6051c0dbbb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:29:59.969692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47334e-4b28-4184-822d-9b6051c0dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:00.000376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4c47334e-4b28-4184-822d-9b6051c0dbbb None None] MFA Rules not processed for user `8b0e4c4605144d6c92ece3380959f1de`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:00.001592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4c47334e-4b28-4184-822d-9b6051c0dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:00.044942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:00.061880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:00.101791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1051/2089] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:00.109544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:00.111298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:00.178987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43543d-ddd9-47c8-bf99-80ceca00cb85 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:00.182775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:00.183422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:00.184567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:00.184905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:00.194966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:00.196471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:00.208067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1039/2090] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:00.419202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47334e-4b28-4184-822d-9b6051c0dbbb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:00.428962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47334e-4b28-4184-822d-9b6051c0dbbb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:00.434342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93350df7-98df-4ed7-a2ad-6ae4f05af9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:00.435347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93350df7-98df-4ed7-a2ad-6ae4f05af9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:00.435691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93350df7-98df-4ed7-a2ad-6ae4f05af9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:00.436029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93350df7-98df-4ed7-a2ad-6ae4f05af9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:00.504357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93350df7-98df-4ed7-a2ad-6ae4f05af9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:00.506385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93350df7-98df-4ed7-a2ad-6ae4f05af9d8 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:00.517853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:00.531459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1052/2091] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:00.655959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:01.100726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:01.165656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e2016-9f8e-4153-957c-2d79f571f609 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:01.171045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:01.171698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:01.171987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:01.179422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] PATH_INFO: `/v3/users/c598f3829d364daaa1df5883aec1bb0e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:01.180849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c598f3829d364daaa1df5883aec1bb0e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:01.181941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:01.182246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:01.182523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:01.182856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:01.218066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] MFA Rules not processed for user `aa5a9394fabf47bb8205d46f2a93f300`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:01.219424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:01.334782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1053/2092] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:01.344198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:01.345775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:01.358958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4532-3610-4a17-80bf-96270f31a497 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:01.363078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:01.363694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:01.363974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:01.364285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:01.374248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:01.375388 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:01.385294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1054/2093] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:01.406107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:01.412478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c598f3829d364daaa1df5883aec1bb0e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:01.413282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c598f3829d364daaa1df5883aec1bb0e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:01.427711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c598f3829d364daaa1df5883aec1bb0e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:01.436380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c598f3829d364daaa1df5883aec1bb0e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:01.437182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98a8d1d3-22f6-4e77-9cc9-f88c88b9edb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c598f3829d364daaa1df5883aec1bb0e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:01.505681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:01.519521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e70a1-c894-4b91-bf8e-8f8f65c8f388 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:01.525225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:01.525954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:01.526357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:01.526708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:01.530542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:01.536112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1040/2094] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:01 2022] DELETE /identity/v3/users/c598f3829d364daaa1df5883aec1bb0e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:01.542540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:01.542789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:01.543646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:01.595010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:01.596973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:01.644713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:01.646506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:01.659281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1055/2095] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:01.702604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1041/2096] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:01.713029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:01.714744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:01.726032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:01.792454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e562a0-7cc0-4fd9-acc7-2fb4391d5074 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:01.849436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:01.850197 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:01.850485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:01.850757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:01.862028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:01.864352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:01.877276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1056/2097] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:02.034728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:02.036183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:02.052497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1e30d-7288-4963-a272-cc8d694bbd93 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:02.059498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:02.060500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:02.061078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:02.061654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] PATH_INFO: `/v3/users/332ca7c7571c4045b8c9b96774e870b0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:02.063683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332ca7c7571c4045b8c9b96774e870b0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:02.066851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:02.364780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332ca7c7571c4045b8c9b96774e870b0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.365662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332ca7c7571c4045b8c9b96774e870b0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.383080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332ca7c7571c4045b8c9b96774e870b0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.399502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332ca7c7571c4045b8c9b96774e870b0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.402349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c078a7fd-bf69-4204-9d68-ea4feb95ff62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332ca7c7571c4045b8c9b96774e870b0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.430277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:02.432029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:02.454685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12319-d8dd-4951-a5e7-a7625f418d54 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:02.478224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:02.478844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:02.479128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:02.479452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] PATH_INFO: `/v3/projects/c7049c217d4e4747990915d8f2d78e71` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:02.481438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7049c217d4e4747990915d8f2d78e71)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:02.483335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:02.506747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:02.526515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1042/2098] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:02 2022] DELETE /identity/v3/users/332ca7c7571c4045b8c9b96774e870b0 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:02.537482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:02.537922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:02.538036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:02.561163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:02.561978 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:02.628408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7049c217d4e4747990915d8f2d78e71', 'request_id': 'req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.629419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1043/2099] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:02.634958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7049c217d4e4747990915d8f2d78e71', 'request_id': 'req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.640924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:02.642421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:02.700988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95a671-9332-4668-8779-8cf67868b46b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:02.753108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:02.753740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:02.753993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:02.754264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:02.757822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7049c217d4e4747990915d8f2d78e71', 'request_id': 'req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.771409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] The token cache is being invalidate because project c7049c217d4e4747990915d8f2d78e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:02.771696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.772376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:02.774094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1057/2100] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:02 2022] DELETE /identity/v3/projects/c7049c217d4e4747990915d8f2d78e71 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:02.777957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:02.779458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:02.828026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:02.829666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:02.840279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1044/2101] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:02.846751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:02.851920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c59e70-0fe1-42e8-a9f3-2ab7ad74310c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:02.857432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:02.858092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:02.858371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:02.858657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] PATH_INFO: `/v3/users/8b0e4c4605144d6c92ece3380959f1de` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:02.859902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0e4c4605144d6c92ece3380959f1de)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:02.861881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:02.944344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:03.128734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0e4c4605144d6c92ece3380959f1de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.132653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0e4c4605144d6c92ece3380959f1de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.147228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0e4c4605144d6c92ece3380959f1de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.150337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0e4c4605144d6c92ece3380959f1de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.263323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0e4c4605144d6c92ece3380959f1de'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.291282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1058/2102] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:02 2022] DELETE /identity/v3/users/8b0e4c4605144d6c92ece3380959f1de => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:03.394151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:03.394151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:03.408669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8cca2-7141-4dca-91fc-c32f37e0dc4a service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:03.507417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:03.508757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:03.509022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:03.509314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] PATH_INFO: `/v3/projects/0e071bef57ea46fda0129eb08352bfe7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:03.511567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e071bef57ea46fda0129eb08352bfe7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:03.512590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:03.513584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:03.699968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e071bef57ea46fda0129eb08352bfe7', 'request_id': 'req-2628fb42-6ba7-4c53-a838-d1e7a883e252'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.705663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e071bef57ea46fda0129eb08352bfe7', 'request_id': 'req-2628fb42-6ba7-4c53-a838-d1e7a883e252'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.711900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e071bef57ea46fda0129eb08352bfe7', 'request_id': 'req-2628fb42-6ba7-4c53-a838-d1e7a883e252'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.810729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] The token cache is being invalidate because project 0e071bef57ea46fda0129eb08352bfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:03.811332 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.812079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:03.813732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1045/2103] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:03 2022] DELETE /identity/v3/projects/0e071bef57ea46fda0129eb08352bfe7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:03.818700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:03.820413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:03.838328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e90f97-2cfc-4b3a-a4a5-4a831c25894e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:03.949162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:03.949835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:03.950405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:03.950721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] PATH_INFO: `/v3/users/0c53fb1063ad40878cc0402e46d3cc79` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:03.952121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c53fb1063ad40878cc0402e46d3cc79)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:03.954284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:04.005708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:04.132796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:04.135508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:04.150990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628fb42-6ba7-4c53-a838-d1e7a883e252 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:04.159255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:04.162283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.162283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.162283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] PATH_INFO: `/v3/projects/4318a31f4ef64c458d7f3d3d5568382f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.162283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4318a31f4ef64c458d7f3d3d5568382f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:04.164787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:04.201588 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c53fb1063ad40878cc0402e46d3cc79'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.202277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c53fb1063ad40878cc0402e46d3cc79'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.220228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c53fb1063ad40878cc0402e46d3cc79'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.221763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c53fb1063ad40878cc0402e46d3cc79'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.289721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45c8b0ed-0fd7-4719-93c8-00514a93d20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c53fb1063ad40878cc0402e46d3cc79'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.300455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4318a31f4ef64c458d7f3d3d5568382f', 'request_id': 'req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.310616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4318a31f4ef64c458d7f3d3d5568382f', 'request_id': 'req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.317350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4318a31f4ef64c458d7f3d3d5568382f', 'request_id': 'req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.318516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1059/2104] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:03 2022] DELETE /identity/v3/users/0c53fb1063ad40878cc0402e46d3cc79 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:04.461672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] The token cache is being invalidate because project 4318a31f4ef64c458d7f3d3d5568382f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:04.461672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.464325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-71be3062-bbf8-4e21-9c85-9fb0ec3afa97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:04.472023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1046/2105] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:04 2022] DELETE /identity/v3/projects/4318a31f4ef64c458d7f3d3d5568382f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:04.473949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a5f2-b7c3-45bc-b56e-f2806ad19f71 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.474256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a5f2-b7c3-45bc-b56e-f2806ad19f71 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.474508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a5f2-b7c3-45bc-b56e-f2806ad19f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.504974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c916a5f2-b7c3-45bc-b56e-f2806ad19f71 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:04.507056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c916a5f2-b7c3-45bc-b56e-f2806ad19f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:04.605898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1060/2106] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:04.617780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee7c25-301a-4b76-8340-e6108eba70f0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.618090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee7c25-301a-4b76-8340-e6108eba70f0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.618966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee7c25-301a-4b76-8340-e6108eba70f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.659556 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5cee7c25-301a-4b76-8340-e6108eba70f0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:04.660818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5cee7c25-301a-4b76-8340-e6108eba70f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:04.669349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1047/2107] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:04.673578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a5f2-b7c3-45bc-b56e-f2806ad19f71 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:04.684982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916a5f2-b7c3-45bc-b56e-f2806ad19f71 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:04.712447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:04.718903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784ccc3-c061-48a6-bdf3-d7e526fbc0a8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.719371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784ccc3-c061-48a6-bdf3-d7e526fbc0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.719661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784ccc3-c061-48a6-bdf3-d7e526fbc0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.719777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.720008 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.720320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.721025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:04.721340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:04.723296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:04.749252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1061/2108] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:04.750636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b784ccc3-c061-48a6-bdf3-d7e526fbc0a8 None None] MFA Rules not processed for user `aa5a9394fabf47bb8205d46f2a93f300`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:04.753871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:04.758427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b784ccc3-c061-48a6-bdf3-d7e526fbc0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:04.769967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3f55d-98bf-4f62-86f7-f04874ce9bfc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:04.782532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:04.787252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:04.787252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.787252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.787489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.787989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:04.790220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:04.830202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:04.868814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1048/2109] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:04.895405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc15bf8-8979-40a2-8b62-7900ce153352 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.895953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc15bf8-8979-40a2-8b62-7900ce153352 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.899808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc15bf8-8979-40a2-8b62-7900ce153352 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.908713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1049/2110] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:30:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:30:04.912188 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3bfe-5a83-4c96-8b67-f7f13827b680 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:04.913631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3bfe-5a83-4c96-8b67-f7f13827b680 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:04.914017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3bfe-5a83-4c96-8b67-f7f13827b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:04.939939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1062/2111] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:04 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:04.944974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:04.953043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:04.966963 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bcfe3bfe-5a83-4c96-8b67-f7f13827b680 None None] MFA Rules not processed for user `69dfae99c30d4a2a89199a3da610b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:04.968800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bcfe3bfe-5a83-4c96-8b67-f7f13827b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.063770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1050/2112] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:05.065037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3bfe-5a83-4c96-8b67-f7f13827b680 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:05.109977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e870f-cc24-4011-8274-f323ece0b3c4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.120638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.121946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.122232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.122512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] PATH_INFO: `/v3/projects/9375adb092ad48788b2c441cd91fe31c` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.123764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9375adb092ad48788b2c441cd91fe31c)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.125726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:05.177238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3bfe-5a83-4c96-8b67-f7f13827b680 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.183054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.184339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.184653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.184934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.185692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.187588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:05.268125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1051/2113] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:05 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:05.269657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:05.272353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9375adb092ad48788b2c441cd91fe31c', 'request_id': 'req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.272568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.279224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9375adb092ad48788b2c441cd91fe31c', 'request_id': 'req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.291942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e23ae-db0a-4856-8c80-4b0c47761d1b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.323713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9375adb092ad48788b2c441cd91fe31c', 'request_id': 'req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.342011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] The token cache is being invalidate because project 9375adb092ad48788b2c441cd91fe31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:05.342400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.343723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.345814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1063/2114] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:04 2022] DELETE /identity/v3/projects/9375adb092ad48788b2c441cd91fe31c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:05.346781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:05.349012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.369410 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.371474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.371474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.371946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.374822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.389563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.391494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:05.403694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1052/2115] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:05.405412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:05.407098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.439863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b03d99-77c6-4ed7-a80f-4ced6ede68e4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.445411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.446165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.446824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.447102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] PATH_INFO: `/v3/users/41aa8acdf78e4e9eb83430919d4ee9be` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.450583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41aa8acdf78e4e9eb83430919d4ee9be)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.454267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:05.490852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dc0b6-6983-40a5-a10e-686ea05b72a5 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.497209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.497834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.498113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.498387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.499042 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.500729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:05.511537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1053/2116] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:05.512798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:05.516441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.533076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5b603-1108-4c6d-b9ce-9d25d237b912 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.541125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.542105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.542582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.543541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] PATH_INFO: `/v3/users/c327294054344eafab45fa7adba616ff` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.545399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c327294054344eafab45fa7adba616ff)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.548832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:05.623481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41aa8acdf78e4e9eb83430919d4ee9be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.624088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41aa8acdf78e4e9eb83430919d4ee9be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.638005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41aa8acdf78e4e9eb83430919d4ee9be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.638777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41aa8acdf78e4e9eb83430919d4ee9be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.746718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41aa8acdf78e4e9eb83430919d4ee9be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.764235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1064/2117] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:05 2022] DELETE /identity/v3/users/41aa8acdf78e4e9eb83430919d4ee9be => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:05.765103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:05.766986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.771251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c327294054344eafab45fa7adba616ff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.772119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c327294054344eafab45fa7adba616ff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.789663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c327294054344eafab45fa7adba616ff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.799996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c327294054344eafab45fa7adba616ff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.801142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-10d9fc31-03d4-491c-b2d8-8f7b5e0a53b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c327294054344eafab45fa7adba616ff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:05.862804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ee352-255a-4f2f-8d19-1a02c2fb4718 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.867812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.868454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.868741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.869012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.869664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.872137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:05.892994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1065/2118] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:05.892994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:05.892994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:05.904958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e08d-90ee-43bb-b162-6bc58ff81b00 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:05.910544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:05.916042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:05.916042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:05.916042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] PATH_INFO: `/v3/projects/fb736f8cf9454e53ab3aec40a23b894b/users/2418998e45cb4c7d9934c41a814c8787/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:05.923570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1054/2119] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:05 2022] DELETE /identity/v3/users/c327294054344eafab45fa7adba616ff => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:05.928359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:05.936677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb736f8cf9454e53ab3aec40a23b894b, user_id=2418998e45cb4c7d9934c41a814c8787, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:05.940645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:06.074371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1066/2120] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:05 2022] PUT /identity/v3/projects/fb736f8cf9454e53ab3aec40a23b894b/users/2418998e45cb4c7d9934c41a814c8787/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:06.087097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.087583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.087985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.138376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] MFA Rules not processed for user `2418998e45cb4c7d9934c41a814c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:06.140855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.228573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:06.228945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1055/2121] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:06.234592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.241366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:06.242944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.319763 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb30c-5e8a-4212-a8ef-f15649e84e39 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:06.324750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:06.325374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.325658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.325928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.330560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:06.337115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:06.338623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:06.346304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265e1aa-65e8-4778-b203-ce2abf957415 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:06.349139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1056/2122] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:06.352234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:06.352834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.353174 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.353457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] PATH_INFO: `/v3/projects/1658d7096b154627b53d5fe39911e444` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.354948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1658d7096b154627b53d5fe39911e444)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:06.361828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:06.381327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:06.399520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c8fd3-dbbe-4911-84a3-dbe023669c58 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:06.414973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:06.414973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.414973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.414973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] PATH_INFO: `/v3/users/2418998e45cb4c7d9934c41a814c8787` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.415360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2418998e45cb4c7d9934c41a814c8787)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:06.416148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:06.472409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1658d7096b154627b53d5fe39911e444', 'request_id': 'req-6a3b433e-9a4a-4235-ae0c-713f58296ab9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.478155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1658d7096b154627b53d5fe39911e444', 'request_id': 'req-6a3b433e-9a4a-4235-ae0c-713f58296ab9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.554733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1658d7096b154627b53d5fe39911e444', 'request_id': 'req-6a3b433e-9a4a-4235-ae0c-713f58296ab9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.574117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] The token cache is being invalidate because project 1658d7096b154627b53d5fe39911e444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:06.574416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.575117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.576660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1067/2123] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:06 2022] DELETE /identity/v3/projects/1658d7096b154627b53d5fe39911e444 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:06.577423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:06.578872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.644011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b433e-9a4a-4235-ae0c-713f58296ab9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:06.655420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:06.656142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.656401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.656682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] PATH_INFO: `/v3/projects/413bbdedb3b94a6da5a3803cf268a8db` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.657878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413bbdedb3b94a6da5a3803cf268a8db)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:06.660077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:06.675809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2418998e45cb4c7d9934c41a814c8787'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.676610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2418998e45cb4c7d9934c41a814c8787'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.690998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2418998e45cb4c7d9934c41a814c8787'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.697712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2418998e45cb4c7d9934c41a814c8787'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.698450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-eeded3d8-23ef-42ac-8710-2e8963ff4763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2418998e45cb4c7d9934c41a814c8787'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.786657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1057/2124] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:06 2022] DELETE /identity/v3/users/2418998e45cb4c7d9934c41a814c8787 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:06.790988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007650c4-29ab-4a99-97c6-bfcd02ab2ec5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.791507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007650c4-29ab-4a99-97c6-bfcd02ab2ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.791886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007650c4-29ab-4a99-97c6-bfcd02ab2ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.801166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413bbdedb3b94a6da5a3803cf268a8db', 'request_id': 'req-17ce9d24-839b-4b9a-acaf-c6d6457a5339'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.807308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413bbdedb3b94a6da5a3803cf268a8db', 'request_id': 'req-17ce9d24-839b-4b9a-acaf-c6d6457a5339'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.813784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-007650c4-29ab-4a99-97c6-bfcd02ab2ec5 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:06.815000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-007650c4-29ab-4a99-97c6-bfcd02ab2ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.879455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1058/2125] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:06.880819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d4e0c-16ec-41da-8b22-e1c14bb35acd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.881106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d4e0c-16ec-41da-8b22-e1c14bb35acd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.881381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d4e0c-16ec-41da-8b22-e1c14bb35acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.901276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cd8d4e0c-16ec-41da-8b22-e1c14bb35acd None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:06.903278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cd8d4e0c-16ec-41da-8b22-e1c14bb35acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.906299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413bbdedb3b94a6da5a3803cf268a8db', 'request_id': 'req-17ce9d24-839b-4b9a-acaf-c6d6457a5339'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.911218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1059/2126] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:06.912628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1db49-030a-463e-9d2b-246a03fcf22f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.912905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1db49-030a-463e-9d2b-246a03fcf22f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.913496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1db49-030a-463e-9d2b-246a03fcf22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.919526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] The token cache is being invalidate because project 413bbdedb3b94a6da5a3803cf268a8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:06.919956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.920894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:06.922604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1068/2127] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:06 2022] DELETE /identity/v3/projects/413bbdedb3b94a6da5a3803cf268a8db => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:06.923436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:06.924786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.933068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-07a1db49-030a-463e-9d2b-246a03fcf22f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:06.937486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-07a1db49-030a-463e-9d2b-246a03fcf22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.949412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1060/2128] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:06.949412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593bf80-6d14-4dc9-80c1-7dbc36631b1f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.949412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593bf80-6d14-4dc9-80c1-7dbc36631b1f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.949412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593bf80-6d14-4dc9-80c1-7dbc36631b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.968884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5593bf80-6d14-4dc9-80c1-7dbc36631b1f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:06.970067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5593bf80-6d14-4dc9-80c1-7dbc36631b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.978323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1061/2129] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:06.986827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593bf80-6d14-4dc9-80c1-7dbc36631b1f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:06.986953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce9d24-839b-4b9a-acaf-c6d6457a5339 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:06.989185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593bf80-6d14-4dc9-80c1-7dbc36631b1f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:06.990217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:06.990703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.990994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.991277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.993298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:06.994785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582c92-872b-498d-a1d3-1598e3e2f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:06.995399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582c92-872b-498d-a1d3-1598e3e2f686 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:06.995746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582c92-872b-498d-a1d3-1598e3e2f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:06.996032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582c92-872b-498d-a1d3-1598e3e2f686 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:06.996760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582c92-872b-498d-a1d3-1598e3e2f686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:06.997062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582c92-872b-498d-a1d3-1598e3e2f686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:06.998703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582c92-872b-498d-a1d3-1598e3e2f686 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.005875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.007397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.013154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1062/2130] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:07.013154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8215a-307b-453b-9fa3-25b10fd67897 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.017421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8215a-307b-453b-9fa3-25b10fd67897 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.017421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8215a-307b-453b-9fa3-25b10fd67897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.036747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-50f8215a-307b-453b-9fa3-25b10fd67897 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:07.038875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-50f8215a-307b-453b-9fa3-25b10fd67897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:07.039105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1069/2131] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:07.039202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.050461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1063/2132] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:07.055406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ee799-b855-45b7-8fa8-cc360c1c1f8d service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.055519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8215a-307b-453b-9fa3-25b10fd67897 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.057957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.058604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.059052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.059251 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.059895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.061863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.064922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8215a-307b-453b-9fa3-25b10fd67897 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.071235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.072122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.072977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.073241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.074474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:07.074815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.077421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.096927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1064/2133] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:07.097826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.107914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350e419-1a57-4663-b44f-47d06bfbb4a8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.112626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.113237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.113571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.113912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.114547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.116602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.142824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1070/2134] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:07 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:07.146912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.209999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:07.219221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1065/2135] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:07 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:07.222814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff0ac2-a9bc-4db5-b8e2-0dd98505dd6e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.230396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.323617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:07.328561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5898d-a547-4806-8567-f892a996e915 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.334090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.334313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.334817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.335099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.335371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.336389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.337988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.345061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.345596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.346033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.346846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.349904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.409949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1071/2136] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:07 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:07.416236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.429565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6ce3-a8b2-4c6f-b201-0b898b825a6e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.433967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.434695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.435092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.435371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.436297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1066/2137] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:07 2022] POST /identity/v3/users => generated 284 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:07.436417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.437207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.438073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.447870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfc9f-eded-4f2d-be5d-7d623e107b19 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.452753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1072/2138] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:30:07.453738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.458514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.458514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.458514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.458514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.459573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.462934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.466533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f259be-72f9-4223-a035-b1dd86c157e3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.472261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.473067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.474495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.474669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1067/2139] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:07.474782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.475429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.483130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.484696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.495242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1073/2140] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:07.496528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.504944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:07.514183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936efac-df77-489f-8ebc-99d2ccec2826 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.517770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25434d0-3343-4bf4-b36a-c65f08a1345f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.523988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.524663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.527910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.527910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] PATH_INFO: `/v3/projects/fb736f8cf9454e53ab3aec40a23b894b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.528692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.528692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.528956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb736f8cf9454e53ab3aec40a23b894b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.529053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.529053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.529053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.529502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.530831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.547374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1068/2141] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:07.547374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.556754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d27e9-5592-4226-a9cb-8a9743cd624b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.562232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.562940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.563748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.564080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] PATH_INFO: `/v3/projects/fd0dea84df9e44318980582674d72465/users/20f965cd3ab343ff9524f46a0b870c2c/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.581195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0dea84df9e44318980582674d72465, user_id=20f965cd3ab343ff9524f46a0b870c2c, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.584697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.651011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1069/2142] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:07 2022] PUT /identity/v3/projects/fd0dea84df9e44318980582674d72465/users/20f965cd3ab343ff9524f46a0b870c2c/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:07.652765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.654246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:07.665356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb736f8cf9454e53ab3aec40a23b894b', 'request_id': 'req-0401e55a-fb9f-449e-b891-0e026123c202'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:07.672128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb736f8cf9454e53ab3aec40a23b894b', 'request_id': 'req-0401e55a-fb9f-449e-b891-0e026123c202'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:07.726073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181f4ff-f045-4621-88df-5b38dea85825 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.745157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb736f8cf9454e53ab3aec40a23b894b', 'request_id': 'req-0401e55a-fb9f-449e-b891-0e026123c202'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:07.757556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] The token cache is being invalidate because project fb736f8cf9454e53ab3aec40a23b894b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:07.757933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:07.758617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:07.760285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1074/2143] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:07 2022] DELETE /identity/v3/projects/fb736f8cf9454e53ab3aec40a23b894b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:07.761155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:07.762814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:07.784694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.785352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.785630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.785902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] PATH_INFO: `/v3/users/8c5e93349d954a27a1dac0188ad10acb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.787029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5e93349d954a27a1dac0188ad10acb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.788986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.828663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e55a-fb9f-449e-b891-0e026123c202 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:07.833430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07776c9d-c08f-4bb4-85c5-e8fed5245210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:07.834116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07776c9d-c08f-4bb4-85c5-e8fed5245210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.834404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07776c9d-c08f-4bb4-85c5-e8fed5245210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.834676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07776c9d-c08f-4bb4-85c5-e8fed5245210 admin admin] PATH_INFO: `/v3/projects/1a0ce17ec19844aa95057cdf13a0aead/users/8896bc4661114244b31b785005ea1483/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.849669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07776c9d-c08f-4bb4-85c5-e8fed5245210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0ce17ec19844aa95057cdf13a0aead, user_id=8896bc4661114244b31b785005ea1483, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:07.852390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07776c9d-c08f-4bb4-85c5-e8fed5245210 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:07.906869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:07.942575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1075/2144] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:07 2022] PUT /identity/v3/projects/1a0ce17ec19844aa95057cdf13a0aead/users/8896bc4661114244b31b785005ea1483/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:07.946210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316e751-c4f3-461c-afab-0fe1a3e7352f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:07.946884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316e751-c4f3-461c-afab-0fe1a3e7352f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:07.947368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316e751-c4f3-461c-afab-0fe1a3e7352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:07.970955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:07.987099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0316e751-c4f3-461c-afab-0fe1a3e7352f None None] MFA Rules not processed for user `20f965cd3ab343ff9524f46a0b870c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:07.988878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0316e751-c4f3-461c-afab-0fe1a3e7352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:07.989518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5e93349d954a27a1dac0188ad10acb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:07.990557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5e93349d954a27a1dac0188ad10acb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:08.010595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5e93349d954a27a1dac0188ad10acb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:08.021831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5e93349d954a27a1dac0188ad10acb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:08.022925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7f1b8ab9-0b32-44d3-aa40-a9c40a686863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5e93349d954a27a1dac0188ad10acb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:08.069586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1076/2145] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:08.070899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.071175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.071455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.090511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:08.091724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:08.131499 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1070/2146] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:07 2022] DELETE /identity/v3/users/8c5e93349d954a27a1dac0188ad10acb => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:08.133092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168246-54e1-4961-8e70-5d5572c9ab1b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.133426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168246-54e1-4961-8e70-5d5572c9ab1b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.133777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168246-54e1-4961-8e70-5d5572c9ab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.153443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1077/2147] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:08.154497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.155857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:08.163703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ec168246-54e1-4961-8e70-5d5572c9ab1b None None] MFA Rules not processed for user `8896bc4661114244b31b785005ea1483`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:08.165083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ec168246-54e1-4961-8e70-5d5572c9ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:08.168427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fc4df-3eb8-4359-8a74-aafcfd8b6d60 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.225371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.226054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.226343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.226624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.227319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.231275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.239050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1071/2148] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:08.239050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0825-a779-429a-8b80-38b6f1896111 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.239050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0825-a779-429a-8b80-38b6f1896111 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.239050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc0825-a779-429a-8b80-38b6f1896111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.258031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-26cc0825-a779-429a-8b80-38b6f1896111 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:08.259352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26cc0825-a779-429a-8b80-38b6f1896111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:08.267335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1072/2149] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:08.268569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.268853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.269134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.288722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:08.289931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:08.298608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1073/2150] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:08.299390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.300630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:08.343911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1078/2151] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:08.348320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.349993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:08.351996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:08.396987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452189c-2dc3-475b-a2f4-d2f6583aa0fe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.415095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:08.419313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19756d1c-65fc-44fb-b268-ee60d981763a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.424870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.424870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.424870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.424870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.460193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514818f5b23c4234b259e5b47e698a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.460902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.461189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.461468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.504425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.505872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.518356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1079/2152] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:08.520655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.535763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fa635-00b6-4272-a416-555b4671fef8 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.542433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.543415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.543889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.544372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.545198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:08.545605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.548429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.550573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.552625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.567527 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1074/2153] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:08.568448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.573032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1080/2154] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:08.577993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.600673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3d346-3e0b-48cb-9651-9cafc3e9dbaf service glance] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.604041 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:08.612611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.612611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.612611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.612611 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.613063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.613063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.614921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11a20-440c-4a00-98de-05b02fe6ce80 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.627614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.628259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.628600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.628889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.629655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.632933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.688291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1075/2155] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:08.701344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.713561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b6af9-cd66-4d4a-a2ad-f400174bd07f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.722399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.723034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.723321 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.723600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.724284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.727421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.759875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1076/2156] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:08.763614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.764052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1081/2157] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:08.768821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:08.782783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ebd3e-d2c1-482d-bcaa-96c9f63ec47c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.853250 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:08.881469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.882624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.882915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.891012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] PATH_INFO: `/v3/projects/f6b122f023d9427ca3ad00a755c824ac/users/4ccd58af9b6148aa90a26566737fe71a/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.891158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beddda-ee39-4d07-8a78-a26a3e8f7084 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:08.895793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:08.896369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:08.896664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:08.897086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:08.897778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.900109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:08.905676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b122f023d9427ca3ad00a755c824ac, user_id=4ccd58af9b6148aa90a26566737fe71a, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:08.909863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.020080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1077/2158] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:08 2022] PUT /identity/v3/projects/f6b122f023d9427ca3ad00a755c824ac/users/4ccd58af9b6148aa90a26566737fe71a/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:09.021199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.048000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1082/2159] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:08 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:09.049398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.062386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68981-89fc-4a51-86c2-82e940d47484 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.107340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4dc5-2fb1-4349-a22f-adbcb4b57334 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.114923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.115606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.116296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.116644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.117490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.119245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.131411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1078/2160] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:30:09.136112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.139353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.140060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.140423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.140775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.141507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.143168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.150714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced075c-caf9-4648-bec1-0fa675350c1a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.157400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1083/2161] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:09.158499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.159570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.160371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.160666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.162418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] PATH_INFO: `/v3/projects/f6b122f023d9427ca3ad00a755c824ac/users/4ccd58af9b6148aa90a26566737fe71a/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.166200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b122f023d9427ca3ad00a755c824ac, user_id=4ccd58af9b6148aa90a26566737fe71a, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.170233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.170594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4137a2-20b3-48ae-b403-30ec4f7341e7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.176548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.177696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.178050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.178637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.179262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.181022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.189728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1079/2162] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:09 2022] PUT /identity/v3/projects/f6b122f023d9427ca3ad00a755c824ac/users/4ccd58af9b6148aa90a26566737fe71a/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:09.196713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1084/2163] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:30:09.198340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.210033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.211050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4963afb-89a9-4b69-af2d-d9fb0061e63c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.215646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:09.217622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:09.287822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dc2a6-e063-47d3-abe0-9f10901e643c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.294331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.295140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.302784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.302784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] PATH_INFO: `/v3/projects/2935815e2b994c959973822916c4178b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.302784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2935815e2b994c959973822916c4178b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.302784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.310300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d267f0a-b13a-43d3-811b-9f35eae3b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.311277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d267f0a-b13a-43d3-811b-9f35eae3b2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.311666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d267f0a-b13a-43d3-811b-9f35eae3b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.312023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d267f0a-b13a-43d3-811b-9f35eae3b2f6 admin admin] PATH_INFO: `/v3/projects/7dc418764e2a4de4bbea10abe1c947ec/users/acbe3e80d07c4543be868aa797aacf05/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.330850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d267f0a-b13a-43d3-811b-9f35eae3b2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc418764e2a4de4bbea10abe1c947ec, user_id=acbe3e80d07c4543be868aa797aacf05, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.333891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d267f0a-b13a-43d3-811b-9f35eae3b2f6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.421809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1085/2164] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:09 2022] PUT /identity/v3/projects/7dc418764e2a4de4bbea10abe1c947ec/users/acbe3e80d07c4543be868aa797aacf05/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:09.423063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3033-eb71-45ed-834a-bc8de02cd4c3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.423356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3033-eb71-45ed-834a-bc8de02cd4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.423638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3033-eb71-45ed-834a-bc8de02cd4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.441085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2935815e2b994c959973822916c4178b', 'request_id': 'req-dec235f3-597c-47de-b484-a62adb8fe6a2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:09.446682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2935815e2b994c959973822916c4178b', 'request_id': 'req-dec235f3-597c-47de-b484-a62adb8fe6a2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:09.452960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2935815e2b994c959973822916c4178b', 'request_id': 'req-dec235f3-597c-47de-b484-a62adb8fe6a2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:09.453861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f8de3033-eb71-45ed-834a-bc8de02cd4c3 None None] MFA Rules not processed for user `4ccd58af9b6148aa90a26566737fe71a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:09.455092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f8de3033-eb71-45ed-834a-bc8de02cd4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:09.536230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1086/2165] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:09.537605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.538113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.538627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.552831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] The token cache is being invalidate because project 2935815e2b994c959973822916c4178b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:09.553282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:09.554104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:09.555915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1080/2166] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:09 2022] DELETE /identity/v3/projects/2935815e2b994c959973822916c4178b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:09.557249 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.559237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:09.581421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] MFA Rules not processed for user `acbe3e80d07c4543be868aa797aacf05`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:09.582648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:09.672194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec235f3-597c-47de-b484-a62adb8fe6a2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.677155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.677872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.678272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.678626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.681623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:09.691054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1087/2167] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:09.691943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.696752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:09.707859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.709516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.722572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1081/2168] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:09.723740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:09.726372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:09.727835 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:09.815730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:09.868748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c02870-36ce-4de6-8963-6a34d8dbc4b5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.879953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6cde-4e9e-478b-a47f-45505d9a1dd6 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:09.880100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.880100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.880100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.880100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] PATH_INFO: `/v3/users/345bbca2067a448caf9e348ce6d378e6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.880463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345bbca2067a448caf9e348ce6d378e6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.881384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:09.882007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:09.882331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:09.882432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:09.882628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:09.883309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:09.885365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:10.008262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1082/2169] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:09 2022] POST /identity/v3/projects => generated 375 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:10.010934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:10.143094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345bbca2067a448caf9e348ce6d378e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:10.144626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345bbca2067a448caf9e348ce6d378e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:10.163648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3115e-0758-4ce8-a092-650d7b48e5ec admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:10.177450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345bbca2067a448caf9e348ce6d378e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:10.178189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345bbca2067a448caf9e348ce6d378e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:10.181057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:10.181711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:10.181999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:10.182352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:10.183006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:10.195288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:10.267042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:10.296850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345bbca2067a448caf9e348ce6d378e6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:10.303093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1083/2170] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:10 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:10.308772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:10.312101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:10.322259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1088/2171] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:09 2022] DELETE /identity/v3/users/345bbca2067a448caf9e348ce6d378e6 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:10.327882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:10.333985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f67fe1-1c93-4049-b599-c4dd7417c6db admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:10.430678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:10.431381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:10.431715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:10.432180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:10.432890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:10.435272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:10.451279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1084/2172] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:10.453054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:10.463597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33ed3-cd12-4fe3-be55-dafac3fb12f9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:10.471664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeedeb-d6a6-4e01-9bc9-8f8e3f095f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:10.472980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeedeb-d6a6-4e01-9bc9-8f8e3f095f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:10.473269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeedeb-d6a6-4e01-9bc9-8f8e3f095f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:10.473597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeedeb-d6a6-4e01-9bc9-8f8e3f095f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:10.475299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeeedeb-d6a6-4e01-9bc9-8f8e3f095f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:10.476700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeeedeb-d6a6-4e01-9bc9-8f8e3f095f40 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:10.492378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1089/2173] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:10.495898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:10.509728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c82fb-c2c4-4008-8d48-a579cd60c1f0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:10.516236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:10.517163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:10.517593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:10.517874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] PATH_INFO: `/v3/projects/99b55400ba3e4f2a95c022197b3e8661/users/169ccadd79864ba8b1669212cc02b67a/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:10.536905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b55400ba3e4f2a95c022197b3e8661, user_id=169ccadd79864ba8b1669212cc02b67a, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:10.539842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:10.623464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1085/2174] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:10 2022] PUT /identity/v3/projects/99b55400ba3e4f2a95c022197b3e8661/users/169ccadd79864ba8b1669212cc02b67a/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:10.637244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:10.637643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:10.637922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:10.703280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] MFA Rules not processed for user `169ccadd79864ba8b1669212cc02b67a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:10.705088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:10.804613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1090/2175] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:10.809148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:10.899226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:10.901367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:10.912339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221a06d-7620-4b88-96c4-70c1f5b8be30 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:10.918124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:10.918750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:10.919033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:10.919365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:10.920142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:10.922216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:10.948259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:10.990639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d4b7-3f5f-4daf-b8a9-85c4b67217ff None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:10.998779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ccd58af9b6148aa90a26566737fe71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6b122f023d9427ca3ad00a755c824ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:10.999365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:10.999659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:10.999943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.001133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:11.001133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.002552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.016703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1091/2176] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:11.020713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.023092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:11.033148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1086/2177] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:10 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:11.033148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.038322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aa9a0-f5df-4bc9-9d4c-31519c2b3fe2 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.104524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.105734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.106028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.106311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] PATH_INFO: `/v3/projects/1261923f7b64465aa9c6277c8f46686a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.107536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1261923f7b64465aa9c6277c8f46686a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.109543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.113355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad611d-4754-4c28-bb71-45766e2bc499 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.119430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ccd58af9b6148aa90a26566737fe71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6b122f023d9427ca3ad00a755c824ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.120167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.121615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.122723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.125909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.125909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.256768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1261923f7b64465aa9c6277c8f46686a', 'request_id': 'req-4ceb3e40-3d9a-4add-9013-f073ff212098'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.257350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1087/2178] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:11 2022] POST /identity/v3/projects => generated 355 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:11.257857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.272323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1261923f7b64465aa9c6277c8f46686a', 'request_id': 'req-4ceb3e40-3d9a-4add-9013-f073ff212098'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.334525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ce29-c8d5-4dcd-bfef-d5ed358b743d tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.341189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.341834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.342114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.342388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.343208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.541550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.543591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1261923f7b64465aa9c6277c8f46686a', 'request_id': 'req-4ceb3e40-3d9a-4add-9013-f073ff212098'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.543591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] The token cache is being invalidate because project 1261923f7b64465aa9c6277c8f46686a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:11.543591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.543591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.543591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1092/2179] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:11 2022] DELETE /identity/v3/projects/1261923f7b64465aa9c6277c8f46686a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:11.545946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.545946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:11.545946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb3e40-3d9a-4add-9013-f073ff212098 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.546470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe5c52-502d-4a7c-bf59-7590a127b764 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ccd58af9b6148aa90a26566737fe71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6b122f023d9427ca3ad00a755c824ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.546470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe5c52-502d-4a7c-bf59-7590a127b764 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.546470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe5c52-502d-4a7c-bf59-7590a127b764 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.546700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe5c52-502d-4a7c-bf59-7590a127b764 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.546700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe5c52-502d-4a7c-bf59-7590a127b764 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:11.546700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe5c52-502d-4a7c-bf59-7590a127b764 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.546700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe5c52-502d-4a7c-bf59-7590a127b764 tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.546700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1093/2180] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:11.547034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc94a2-bc63-4bef-a07c-f9398acf87e0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.547034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc94a2-bc63-4bef-a07c-f9398acf87e0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.547034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc94a2-bc63-4bef-a07c-f9398acf87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.550486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b2bc94a2-bc63-4bef-a07c-f9398acf87e0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:11.551994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b2bc94a2-bc63-4bef-a07c-f9398acf87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:11.562338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1094/2181] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:11.571034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b18067-004d-4a6e-bb88-9f31b378f69a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.571348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b18067-004d-4a6e-bb88-9f31b378f69a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.571631 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b18067-004d-4a6e-bb88-9f31b378f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.593406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d9b18067-004d-4a6e-bb88-9f31b378f69a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:11.594648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d9b18067-004d-4a6e-bb88-9f31b378f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:11.607983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1095/2182] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:11.607983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b18067-004d-4a6e-bb88-9f31b378f69a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.619376 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b18067-004d-4a6e-bb88-9f31b378f69a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.625212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ccd58af9b6148aa90a26566737fe71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6b122f023d9427ca3ad00a755c824ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.625871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.626193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.626531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] PATH_INFO: `/v3/projects/b953aaf8f7384ce196b09b2703689af8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.627693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b953aaf8f7384ce196b09b2703689af8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.629712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.757732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1088/2183] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:11 2022] POST /identity/v3/users => generated 295 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:11.764176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.766718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:11.773670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d84ab-2691-4b0f-9950-03357e0f82c2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.789711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b953aaf8f7384ce196b09b2703689af8', 'request_id': 'req-b5c46b9a-8d77-4da9-8b96-40af9624e41c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.803984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b953aaf8f7384ce196b09b2703689af8', 'request_id': 'req-b5c46b9a-8d77-4da9-8b96-40af9624e41c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.841883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.842592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.843013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.843305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.843952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:11.844292 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.846020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.859745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1089/2184] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:11.860610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.862288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:11.884591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4dfc3-b494-45c0-b033-8f15e052321d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.890859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.891473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.891753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.892028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.892895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.894961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.900526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b953aaf8f7384ce196b09b2703689af8', 'request_id': 'req-b5c46b9a-8d77-4da9-8b96-40af9624e41c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.910316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1090/2185] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:11.910316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.915556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] The token cache is being invalidate because project b953aaf8f7384ce196b09b2703689af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:11.916070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.916895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:11.918317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc52af-9f25-4e39-85cf-d05f6b077811 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.922135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1096/2186] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:11 2022] DELETE /identity/v3/projects/b953aaf8f7384ce196b09b2703689af8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:11.922135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:11.922135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:11.927790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.928444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.928727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.929002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.930317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.932549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:11.936865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c46b9a-8d77-4da9-8b96-40af9624e41c tempest-VolumeQuotaClassesTest-211801104 tempest-VolumeQuotaClassesTest-211801104-project-admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:11.943119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:11.943802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:11.944090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:11.944539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] PATH_INFO: `/v3/projects/0cb344523e8a434bada7e35666a3e698/users/f99db67ef5cc454093f2784838ede809/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:11.963946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:11.972294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb344523e8a434bada7e35666a3e698, user_id=f99db67ef5cc454093f2784838ede809, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:11.975378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.062960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1091/2187] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:11 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:12.067037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.068848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:12.079276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1097/2188] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:11 2022] PUT /identity/v3/projects/0cb344523e8a434bada7e35666a3e698/users/f99db67ef5cc454093f2784838ede809/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:12.084162 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.146046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe88f2-a7db-40d7-8e9a-f4c2920357e3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.161409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954a53b-d325-4188-a3a4-dd69be3a09cc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.166462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.172034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.172034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.172034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.172034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.172034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.181593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1098/2189] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:12.186360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.196029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95651a-6d79-469e-b4b3-8d9ac8b25c62 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.201144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c7d9-3eae-4465-ac77-749439abfdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.201798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c7d9-3eae-4465-ac77-749439abfdc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.202081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c7d9-3eae-4465-ac77-749439abfdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.202356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c7d9-3eae-4465-ac77-749439abfdc0 admin admin] PATH_INFO: `/v3/projects/0cb344523e8a434bada7e35666a3e698/users/f99db67ef5cc454093f2784838ede809/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.204389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6c7d9-3eae-4465-ac77-749439abfdc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb344523e8a434bada7e35666a3e698, user_id=f99db67ef5cc454093f2784838ede809, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.206591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.207016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6c7d9-3eae-4465-ac77-749439abfdc0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.207369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.207724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.208068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.208798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.210868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.218195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1099/2190] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:12 2022] PUT /identity/v3/projects/0cb344523e8a434bada7e35666a3e698/users/f99db67ef5cc454093f2784838ede809/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:12.228414 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.228709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.228987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.257870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] MFA Rules not processed for user `f99db67ef5cc454093f2784838ede809`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:12.262171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:12.295599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1092/2191] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:12 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:12.299902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.310538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0f12-c26a-457d-878e-294bdc55e4b9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.328263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1100/2192] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:12.339105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.340856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:12.370452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.372458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.372747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.373033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.373697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.375320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.389304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1093/2193] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:30:12.392954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.403717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa7e1-e2a6-4652-90ff-2408aff3aba6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.409028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.409785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.410133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.413702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.413893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c002a-f6e2-4000-8798-5969ac2a7ae9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.413997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.413997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.418364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df017f07-5946-4702-bfb6-b11853d14d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.419879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017f07-5946-4702-bfb6-b11853d14d91 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.420268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017f07-5946-4702-bfb6-b11853d14d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.420560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017f07-5946-4702-bfb6-b11853d14d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.422828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-df017f07-5946-4702-bfb6-b11853d14d91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:12.426448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1094/2194] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:12.430798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.442352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614cce0-1bcd-46e1-9948-1c9bfe4c63ea admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.447219 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.448185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.449987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.454490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] PATH_INFO: `/v3/projects/4283cae3cde542c0ae65b606e3ed6664/users/0c3682134ad14c4ca96fff76cfd6219d/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.484855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4283cae3cde542c0ae65b606e3ed6664, user_id=0c3682134ad14c4ca96fff76cfd6219d, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.484855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.502315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df017f07-5946-4702-bfb6-b11853d14d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.504382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df017f07-5946-4702-bfb6-b11853d14d91 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.514137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1101/2195] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:12.536364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1095/2196] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:12 2022] PUT /identity/v3/projects/4283cae3cde542c0ae65b606e3ed6664/users/0c3682134ad14c4ca96fff76cfd6219d/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:12.547636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.548086 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.548400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.583203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] MFA Rules not processed for user `0c3682134ad14c4ca96fff76cfd6219d`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:12.584498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:12.592578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:12.635266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.637716 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:12.660941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1102/2197] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:12.662526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:12.673429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.675340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:12.718076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733895-ce5f-4c9c-83f9-9b84bf8d8285 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.723175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.723844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.724184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.724494 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] PATH_INFO: `/v3/users/20f965cd3ab343ff9524f46a0b870c2c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.725684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f965cd3ab343ff9524f46a0b870c2c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.727702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.737341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf266e-297b-46d9-bb7d-3b6324528611 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.741032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.741710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.742010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.742284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.756417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.757870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.769369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1103/2198] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:12.794448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:12.804765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc0169-cdb8-43d5-87a2-099b7cc1478f service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:12.809910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:12.810534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:12.810941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:12.811227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] PATH_INFO: `/v3/users/0c3682134ad14c4ca96fff76cfd6219d` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:12.812411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3682134ad14c4ca96fff76cfd6219d)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:12.814335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:12.926058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f965cd3ab343ff9524f46a0b870c2c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:12.926783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f965cd3ab343ff9524f46a0b870c2c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:12.938883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f965cd3ab343ff9524f46a0b870c2c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:12.949725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f965cd3ab343ff9524f46a0b870c2c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:12.949725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-733e868a-3b41-4daf-ad26-c3596fc7d0a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f965cd3ab343ff9524f46a0b870c2c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:13.050862 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1096/2199] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:12 2022] DELETE /identity/v3/users/20f965cd3ab343ff9524f46a0b870c2c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:13.055550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:13.056016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:13.056278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3682134ad14c4ca96fff76cfd6219d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:13.056720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:13.057688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3682134ad14c4ca96fff76cfd6219d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:13.071999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3682134ad14c4ca96fff76cfd6219d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:13.073329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3682134ad14c4ca96fff76cfd6219d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:13.076908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:13.078134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:13.084819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:13.141078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61f47ec0-25ba-465a-a380-647cfc15fb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3682134ad14c4ca96fff76cfd6219d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:13.161085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1104/2200] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:12 2022] DELETE /identity/v3/users/0c3682134ad14c4ca96fff76cfd6219d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:13.174118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3f94-9bc2-4e43-a061-6d302387dd55 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:13.174118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3f94-9bc2-4e43-a061-6d302387dd55 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:13.174118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3f94-9bc2-4e43-a061-6d302387dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:13.174387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1097/2201] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:13.182512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:13.188306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:13.192452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9bdf3f94-9bc2-4e43-a061-6d302387dd55 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:13.193694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9bdf3f94-9bc2-4e43-a061-6d302387dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:13.252163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b71d0e-140c-4424-ac09-b16347d50979 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:13.274839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1105/2202] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:13.277667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:13.281589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3f94-9bc2-4e43-a061-6d302387dd55 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:13.305154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:13.305751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:13.306026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:13.306295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:13.316127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:13.318637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:13.330778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:13.331506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1098/2203] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:13.340584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3f94-9bc2-4e43-a061-6d302387dd55 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:13.344488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:13.345105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:13.345391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:13.345669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:13.356375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:13.357891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:13.368604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1106/2204] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:13.644368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:13.786555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:13.815232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:14.038228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:14.039745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:14.043557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:14.045343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:14.063679 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de149b-48f7-487c-9e72-aeb6b0460538 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:14.064204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8301b9c-9c0d-42fd-81df-0637267309fa service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:14.069752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:14.070780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:14.070959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.071339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.071624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.071770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.071905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] PATH_INFO: `/v3/projects/4283cae3cde542c0ae65b606e3ed6664` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.072351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] PATH_INFO: `/v3/projects/fd0dea84df9e44318980582674d72465` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.074358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4283cae3cde542c0ae65b606e3ed6664)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:14.075115 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0dea84df9e44318980582674d72465)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:14.077173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:14.078507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:14.219872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4283cae3cde542c0ae65b606e3ed6664', 'request_id': 'req-573cdec2-8c4b-462d-9b74-5297e82f16ad'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.235081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4283cae3cde542c0ae65b606e3ed6664', 'request_id': 'req-573cdec2-8c4b-462d-9b74-5297e82f16ad'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.261862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0dea84df9e44318980582674d72465', 'request_id': 'req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.273277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4283cae3cde542c0ae65b606e3ed6664', 'request_id': 'req-573cdec2-8c4b-462d-9b74-5297e82f16ad'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.278833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0dea84df9e44318980582674d72465', 'request_id': 'req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.376138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] The token cache is being invalidate because project 4283cae3cde542c0ae65b606e3ed6664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:14.378176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.378176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-573cdec2-8c4b-462d-9b74-5297e82f16ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.379175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1099/2205] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:14 2022] DELETE /identity/v3/projects/4283cae3cde542c0ae65b606e3ed6664 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:14.383480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f41c5-c354-4115-bed9-5ffe0f32b2ca None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.383771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f41c5-c354-4115-bed9-5ffe0f32b2ca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.384058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f41c5-c354-4115-bed9-5ffe0f32b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.410680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a09f41c5-c354-4115-bed9-5ffe0f32b2ca None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:14.411882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a09f41c5-c354-4115-bed9-5ffe0f32b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:14.471566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:14.490616 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1100/2206] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:14.499724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d946-5c7e-45e8-8e2e-a0176fc7544d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.500014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d946-5c7e-45e8-8e2e-a0176fc7544d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.500379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d946-5c7e-45e8-8e2e-a0176fc7544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.505869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0dea84df9e44318980582674d72465', 'request_id': 'req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.519806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] The token cache is being invalidate because project fd0dea84df9e44318980582674d72465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:14.520101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.520781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.522375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1107/2207] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:14 2022] DELETE /identity/v3/projects/fd0dea84df9e44318980582674d72465 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:14.522580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ea68d946-5c7e-45e8-8e2e-a0176fc7544d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:14.524102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ea68d946-5c7e-45e8-8e2e-a0176fc7544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:14.526426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:14.529390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:14.533870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1101/2208] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:14.542206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68d946-5c7e-45e8-8e2e-a0176fc7544d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:14.544711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936fd2a-43fd-4e0d-9d77-7c8d6bd6d01b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:14.549379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:14.550585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.550853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.551143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] PATH_INFO: `/v3/users/4ccd58af9b6148aa90a26566737fe71a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.552386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccd58af9b6148aa90a26566737fe71a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:14.553379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68d946-5c7e-45e8-8e2e-a0176fc7544d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:14.554271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:14.559242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:14.559889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.560169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.560486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.561139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:14.561444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:14.563034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:14.575686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1102/2209] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:30:14.580116 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:14.590995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8290-1bd8-4588-97f0-cc183ca27692 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:14.595542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:14.596151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.596528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.596809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.597431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:14.599313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:14.731145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1103/2210] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:14 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:14.735248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:14.754549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccd58af9b6148aa90a26566737fe71a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.756312 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccd58af9b6148aa90a26566737fe71a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.770954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccd58af9b6148aa90a26566737fe71a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.771843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccd58af9b6148aa90a26566737fe71a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.806014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e136f-2768-407c-8a87-9096652334e4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:14.812404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:14.813082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:14.813363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:14.813635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:14.814276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:14.816241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:14.837185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccd58af9b6148aa90a26566737fe71a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:14.850492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1108/2211] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:14 2022] DELETE /identity/v3/users/4ccd58af9b6148aa90a26566737fe71a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:14.911536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1104/2212] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:14 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:14.915786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:14.917375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:14.990474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:15.046768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5048b-c0bb-4eb8-8a3a-6a64d3607d61 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:15.052067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:15.052351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.052569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.052872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.053554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:15.055234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:15.068690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1109/2213] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:15.070805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:15.089252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa31a1-87d6-419e-afe9-81a3a05def9b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:15.094486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a4300-777a-45fd-9ce3-d5f9dc8aa57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:15.095105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4300-777a-45fd-9ce3-d5f9dc8aa57c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.095394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4300-777a-45fd-9ce3-d5f9dc8aa57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.095651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4300-777a-45fd-9ce3-d5f9dc8aa57c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.096375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a4300-777a-45fd-9ce3-d5f9dc8aa57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:15.097999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a4300-777a-45fd-9ce3-d5f9dc8aa57c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:15.115608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1105/2214] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:15.124234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:15.145626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96b11-6e51-4412-befd-27cdbede1958 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:15.162541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:15.163340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.163725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.165280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] PATH_INFO: `/v3/projects/d6c2965a04044a449f256a18f345b3a5/users/cbaafc5331d0405f85be84e40fe500d2/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.183933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c2965a04044a449f256a18f345b3a5, user_id=cbaafc5331d0405f85be84e40fe500d2, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:15.187466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:15.271215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1110/2215] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:15 2022] PUT /identity/v3/projects/d6c2965a04044a449f256a18f345b3a5/users/cbaafc5331d0405f85be84e40fe500d2/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:15.279363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.279888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.281612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.344799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] MFA Rules not processed for user `cbaafc5331d0405f85be84e40fe500d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:15.346627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:15.366023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:15.381157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:15.476529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1106/2216] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:15.489834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:15.490953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:15.514269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:15.556347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349a93a-82e6-4ec6-be73-71f2c1dd5dfd admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:15.562323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:15.563200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.563482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.563760 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] PATH_INFO: `/v3/projects/f6b122f023d9427ca3ad00a755c824ac` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.566108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b122f023d9427ca3ad00a755c824ac)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:15.569654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:15.626856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b4f6-d9c8-4569-b961-dcfd42890f10 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:15.643187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514818f5b23c4234b259e5b47e698a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:15.644057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.644521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.644997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.659181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:15.660812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:15.672507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1107/2217] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:15.762414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:15.762414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:15.778253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b122f023d9427ca3ad00a755c824ac', 'request_id': 'req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:15.785863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b122f023d9427ca3ad00a755c824ac', 'request_id': 'req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:15.840681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe07418-ac96-4c97-a10a-3a07f13ee7c0 service glance] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:15.852271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b122f023d9427ca3ad00a755c824ac', 'request_id': 'req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:15.867569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] The token cache is being invalidate because project f6b122f023d9427ca3ad00a755c824ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:15.868020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:15.868880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-78ff2258-f0b9-4a6d-9a90-4eb2e41e3052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:15.874071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1111/2218] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:15 2022] DELETE /identity/v3/projects/f6b122f023d9427ca3ad00a755c824ac => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:15.876315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2cfac-1291-4557-b018-5f6e58270357 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.876714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2cfac-1291-4557-b018-5f6e58270357 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.878170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2cfac-1291-4557-b018-5f6e58270357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.902646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2de2cfac-1291-4557-b018-5f6e58270357 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:15.904014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2de2cfac-1291-4557-b018-5f6e58270357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:15.905323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:15.906113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:15.906559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:15.907010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:15.910325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:15.962200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:16.023808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:16.025578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:16.028964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1112/2219] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:16.037038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26179421-5724-41c8-a065-8c3cc238fb39 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.037336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26179421-5724-41c8-a065-8c3cc238fb39 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.037620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26179421-5724-41c8-a065-8c3cc238fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.055316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1108/2220] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:16.069454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-26179421-5724-41c8-a065-8c3cc238fb39 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:16.071044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-26179421-5724-41c8-a065-8c3cc238fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:16.086465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1113/2221] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:16.088630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:16.103572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c2905-59e4-4fe5-b0c0-227d73c61f46 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:16.111172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:16.112089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.112707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.117133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.117133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:16.117133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:16.117133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:16.129656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1109/2222] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:16.134336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26179421-5724-41c8-a065-8c3cc238fb39 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:16.144127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26179421-5724-41c8-a065-8c3cc238fb39 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:16.149667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:16.150240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.150780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.152724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.153407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:16.156728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:16.326678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1114/2223] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:16 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:16.334924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:16.374534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487d5b8-3cac-4119-87b9-96374b4de71b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:16.397558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:16.453265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:16.453881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.454165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.454440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.455062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:16.457033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:16.552335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1110/2224] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:16 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:16.555682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:16.566560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2e5d-39a5-4182-b587-43f7dbf01d97 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:16.571320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:16.572044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.572374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.572717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.573959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:16.576060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:16.601503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1115/2225] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:16.609308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:16.619974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3eaf-dbe2-4c93-bf44-1dbb42d2927c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:16.625455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b95cef-f9ce-4958-97f7-6f5fa79821d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:16.629173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95cef-f9ce-4958-97f7-6f5fa79821d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.629173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95cef-f9ce-4958-97f7-6f5fa79821d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.629173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b95cef-f9ce-4958-97f7-6f5fa79821d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.629173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b95cef-f9ce-4958-97f7-6f5fa79821d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:16.629173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b95cef-f9ce-4958-97f7-6f5fa79821d0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:16.646708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1111/2226] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:16.648540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:16.660679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ca11f-2d29-4846-8f19-3fd7e6b7a75d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:16.667447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:16.668440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.668729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.669005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] PATH_INFO: `/v3/projects/991252baad524f459df7adb10bcbfa14/users/7355131fd5dd4a1b97a04905a7508046/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.692202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991252baad524f459df7adb10bcbfa14, user_id=7355131fd5dd4a1b97a04905a7508046, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:16.692202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:16.783318 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1116/2227] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:16 2022] PUT /identity/v3/projects/991252baad524f459df7adb10bcbfa14/users/7355131fd5dd4a1b97a04905a7508046/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:16.797453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d423ddd-526d-4561-aac9-a47a0b5ac02c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:16.798094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d423ddd-526d-4561-aac9-a47a0b5ac02c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:16.804887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d423ddd-526d-4561-aac9-a47a0b5ac02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:16.851510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4d423ddd-526d-4561-aac9-a47a0b5ac02c None None] MFA Rules not processed for user `7355131fd5dd4a1b97a04905a7508046`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:16.853186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d423ddd-526d-4561-aac9-a47a0b5ac02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:16.997049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1112/2228] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:17.003703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:17.074895 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b2d62-44bb-4f8d-8cac-a00b7ca292b5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:17.079601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:17.080233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.080662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.080943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.081571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:17.083472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:17.175194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1117/2229] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:17 2022] POST /identity/v3/projects => generated 391 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:17.179365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d423ddd-526d-4561-aac9-a47a0b5ac02c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:17.191058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d423ddd-526d-4561-aac9-a47a0b5ac02c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:17.258898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:17.259508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.259793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.260075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.261063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:17.263004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:17.344539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1113/2230] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:17 2022] POST /identity/v3/users => generated 302 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:17.345220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:17.355485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2d33c-c7a1-4d98-8c9c-88e382f72289 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:17.360107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:17.360751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.361036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.361317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.361965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:17.363555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:17.374351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1118/2231] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:17.378761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:17.389787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a6027-27fc-4b4a-b324-375921b5d809 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:17.395816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:17.396628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.396919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.397202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] PATH_INFO: `/v3/projects/42ebe0db6a0f43c4aee5aeae89ff7f3c/users/83b7e4b541984698a94ee05e1c2486ec/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.407753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:17.416087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ebe0db6a0f43c4aee5aeae89ff7f3c, user_id=83b7e4b541984698a94ee05e1c2486ec, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:17.420786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:17.508127 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1114/2232] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:17 2022] PUT /identity/v3/projects/42ebe0db6a0f43c4aee5aeae89ff7f3c/users/83b7e4b541984698a94ee05e1c2486ec/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:17.513108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:17.524522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a498ca-a16d-4523-aca5-536490f1a934 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:17.572177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:17.604132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6df895-9409-44b2-830a-e0f4c8579c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:17.604132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df895-9409-44b2-830a-e0f4c8579c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.604132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df895-9409-44b2-830a-e0f4c8579c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.604132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df895-9409-44b2-830a-e0f4c8579c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.605389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6df895-9409-44b2-830a-e0f4c8579c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:17.605389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6df895-9409-44b2-830a-e0f4c8579c58 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:17.618937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1119/2233] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:17.627019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:17.634052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4be0-0517-421f-b428-f79278bb0499 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:17.640091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:17.640770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.641119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.641465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] PATH_INFO: `/v3/projects/42ebe0db6a0f43c4aee5aeae89ff7f3c/users/83b7e4b541984698a94ee05e1c2486ec/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.644041 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ebe0db6a0f43c4aee5aeae89ff7f3c, user_id=83b7e4b541984698a94ee05e1c2486ec, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:17.647447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:17.665681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1115/2234] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:17 2022] PUT /identity/v3/projects/42ebe0db6a0f43c4aee5aeae89ff7f3c/users/83b7e4b541984698a94ee05e1c2486ec/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:17.685307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.685703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.686078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.719285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] MFA Rules not processed for user `83b7e4b541984698a94ee05e1c2486ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:17.720765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:17.826577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1120/2235] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:17.837523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:17.839280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:17.939696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70d49-6302-4e80-bc54-5a3e790146e4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:17.944062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:17.944834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:17.945467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:17.945830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:17.958176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:17.959721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:17.971422 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1116/2236] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:17 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:18.084246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:18.087987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:18.117490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c12dc-e27c-453d-b8c0-cde606cf8cc6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:18.125624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:18.126696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:18.134737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:18.135309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:18.252705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:18.255475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:18.262979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:18.268341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1121/2237] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:18.283930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2b560-619e-41f3-ac41-813aeb1099b6 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:18.291351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:18.293658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:18.294528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:18.295631 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:18.298782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:18.398324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:18.399794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:18.410603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1117/2238] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:24.267777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:24.269289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:24.339999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:24.344443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c472-d2df-4056-83eb-93b6d9de0947 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:24.349557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:24.350340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:24.350685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:24.351021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] PATH_INFO: `/v3/users/acbe3e80d07c4543be868aa797aacf05` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:24.352161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbe3e80d07c4543be868aa797aacf05)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:24.354119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:24.454979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:24.466139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bcb058-384b-40aa-ada1-acd18011435a service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:24.473870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:24.475636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:24.475636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:24.475636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] PATH_INFO: `/v3/users/7355131fd5dd4a1b97a04905a7508046` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:24.476298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7355131fd5dd4a1b97a04905a7508046)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:24.478268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:24.560237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbe3e80d07c4543be868aa797aacf05'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.560939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbe3e80d07c4543be868aa797aacf05'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.574151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbe3e80d07c4543be868aa797aacf05'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.575090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbe3e80d07c4543be868aa797aacf05'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.688713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-672f3005-388a-4843-9ce2-ec35677f37d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbe3e80d07c4543be868aa797aacf05'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.701978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1122/2239] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:24 2022] DELETE /identity/v3/users/acbe3e80d07c4543be868aa797aacf05 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:24.706524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:24.706816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:24.707097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:24.727060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:24.728300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:24.731927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7355131fd5dd4a1b97a04905a7508046'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.732753 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7355131fd5dd4a1b97a04905a7508046'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.749110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7355131fd5dd4a1b97a04905a7508046'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.750462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:24.756662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7355131fd5dd4a1b97a04905a7508046'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.758059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f632ca1-578c-4428-a982-c41bb95b76d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7355131fd5dd4a1b97a04905a7508046'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:24.791469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1123/2240] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:24.802177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:24.803552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:24.849021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1118/2241] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:24 2022] DELETE /identity/v3/users/7355131fd5dd4a1b97a04905a7508046 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:24.853558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:24.853952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:24.854141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:24.863773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc3593-34ef-4919-85ad-83330a599901 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:24.875946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:24.877291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:24.898281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:24.919825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:24.920551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:24.920908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:24.921338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:24.941547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1119/2242] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:24.952409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:24.953784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:24.977207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c0953-969c-40a2-b35f-92bac290f8be None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:24.982250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:24.983006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:24.983608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:24.983608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:24.995458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:24.997165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:24.997600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:24.999230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:25.008231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1120/2243] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:25.013350 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1124/2244] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:25.456072 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:25.459079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:25.473519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e6012-7d8e-41cc-aa4a-c6aef5fb120e service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:25.489652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:25.491808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:25.493924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:25.494689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:25.496248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:25.496248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] PATH_INFO: `/v3/projects/991252baad524f459df7adb10bcbfa14` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:25.497745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991252baad524f459df7adb10bcbfa14)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:25.499660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:25.513510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8357-c716-4daa-84ed-515eba40916c service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:25.526687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:25.527585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:25.528054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:25.528622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] PATH_INFO: `/v3/projects/7dc418764e2a4de4bbea10abe1c947ec` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:25.530140 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc418764e2a4de4bbea10abe1c947ec)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:25.532599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:25.662243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991252baad524f459df7adb10bcbfa14', 'request_id': 'req-1ccc2263-0545-446c-bbea-ff3304fe26a9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.665405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc418764e2a4de4bbea10abe1c947ec', 'request_id': 'req-45556127-4363-4b23-884a-3b75bd214f7c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.667909 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991252baad524f459df7adb10bcbfa14', 'request_id': 'req-1ccc2263-0545-446c-bbea-ff3304fe26a9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.671017 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc418764e2a4de4bbea10abe1c947ec', 'request_id': 'req-45556127-4363-4b23-884a-3b75bd214f7c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.675818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991252baad524f459df7adb10bcbfa14', 'request_id': 'req-1ccc2263-0545-446c-bbea-ff3304fe26a9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.739361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc418764e2a4de4bbea10abe1c947ec', 'request_id': 'req-45556127-4363-4b23-884a-3b75bd214f7c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.753983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] The token cache is being invalidate because project 7dc418764e2a4de4bbea10abe1c947ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:25.754311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.754969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.756552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1125/2245] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:25 2022] DELETE /identity/v3/projects/7dc418764e2a4de4bbea10abe1c947ec => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:25.761359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:25.762669 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:25.831490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] The token cache is being invalidate because project 991252baad524f459df7adb10bcbfa14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:25.831830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.832324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45556127-4363-4b23-884a-3b75bd214f7c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:25.832496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:25.834312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1121/2246] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:25 2022] DELETE /identity/v3/projects/991252baad524f459df7adb10bcbfa14 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:25.840169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:25.840311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:25.840438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:25.840552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:25.840777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:25.841107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] PATH_INFO: `/v3/users/169ccadd79864ba8b1669212cc02b67a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:25.842313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=169ccadd79864ba8b1669212cc02b67a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:25.844700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:25.855952 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:25.922219 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:25.936681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc2263-0545-446c-bbea-ff3304fe26a9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:25.945670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:25.945670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:25.945670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:25.945670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] PATH_INFO: `/v3/users/83b7e4b541984698a94ee05e1c2486ec` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:25.946091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b7e4b541984698a94ee05e1c2486ec)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:25.946091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:26.040418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169ccadd79864ba8b1669212cc02b67a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.041295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169ccadd79864ba8b1669212cc02b67a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.060795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169ccadd79864ba8b1669212cc02b67a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.061696 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169ccadd79864ba8b1669212cc02b67a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.126669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b7e4b541984698a94ee05e1c2486ec'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.127496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b7e4b541984698a94ee05e1c2486ec'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.134665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169ccadd79864ba8b1669212cc02b67a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.142247 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b7e4b541984698a94ee05e1c2486ec'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.148101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1126/2247] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:25 2022] DELETE /identity/v3/users/169ccadd79864ba8b1669212cc02b67a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:26.153696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b7e4b541984698a94ee05e1c2486ec'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.154549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b7e4b541984698a94ee05e1c2486ec'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:26.270942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1122/2248] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:25 2022] DELETE /identity/v3/users/83b7e4b541984698a94ee05e1c2486ec => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:26.741759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:26.743224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:26.768262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:26.770515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:26.830839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723536-7128-4674-91f2-c2d401c33dda admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:26.867215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306c55b-592f-48ae-9e7a-04edacb8776a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:26.872126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:26.872826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:26.873110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:26.873386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] PATH_INFO: `/v3/projects/42ebe0db6a0f43c4aee5aeae89ff7f3c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:26.874518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ebe0db6a0f43c4aee5aeae89ff7f3c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:26.876805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:26.900438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:26.901667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:26.901966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:26.904645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] PATH_INFO: `/v3/projects/99b55400ba3e4f2a95c022197b3e8661` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:26.906578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b55400ba3e4f2a95c022197b3e8661)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:26.908563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.001027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:27.010880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b55400ba3e4f2a95c022197b3e8661', 'request_id': 'req-a9e1870c-f46f-45dd-b37b-356553661b81'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.013375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ebe0db6a0f43c4aee5aeae89ff7f3c', 'request_id': 'req-5fa2c251-60cb-4da8-8b75-283d4a8c9150'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.016425 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b55400ba3e4f2a95c022197b3e8661', 'request_id': 'req-a9e1870c-f46f-45dd-b37b-356553661b81'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.021425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ebe0db6a0f43c4aee5aeae89ff7f3c', 'request_id': 'req-5fa2c251-60cb-4da8-8b75-283d4a8c9150'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.025299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ebe0db6a0f43c4aee5aeae89ff7f3c', 'request_id': 'req-5fa2c251-60cb-4da8-8b75-283d4a8c9150'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.076963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b55400ba3e4f2a95c022197b3e8661', 'request_id': 'req-a9e1870c-f46f-45dd-b37b-356553661b81'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.089719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] The token cache is being invalidate because project 99b55400ba3e4f2a95c022197b3e8661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:27.090008 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.090678 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.092296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1127/2249] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:26 2022] DELETE /identity/v3/projects/99b55400ba3e4f2a95c022197b3e8661 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:27.096444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.097718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:27.124072 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] The token cache is being invalidate because project 42ebe0db6a0f43c4aee5aeae89ff7f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:27.124495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.125067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5fa2c251-60cb-4da8-8b75-283d4a8c9150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.131352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1123/2250] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:26 2022] DELETE /identity/v3/projects/42ebe0db6a0f43c4aee5aeae89ff7f3c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:27.132910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5cd8a-60da-4dd9-864b-a5d5858123ef None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.133207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5cd8a-60da-4dd9-864b-a5d5858123ef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.133485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5cd8a-60da-4dd9-864b-a5d5858123ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.144394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:27.160748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-acb5cd8a-60da-4dd9-864b-a5d5858123ef None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:27.162404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-acb5cd8a-60da-4dd9-864b-a5d5858123ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:27.174138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1870c-f46f-45dd-b37b-356553661b81 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:27.252264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1124/2251] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:27.254065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:27.254712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.254995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.255167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc856d8-1de9-4743-a0ae-135184ccc73f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.255267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] PATH_INFO: `/v3/users/f99db67ef5cc454093f2784838ede809` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.255462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc856d8-1de9-4743-a0ae-135184ccc73f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.255802 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc856d8-1de9-4743-a0ae-135184ccc73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.256701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99db67ef5cc454093f2784838ede809)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:27.258600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.293853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5fc856d8-1de9-4743-a0ae-135184ccc73f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:27.295309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5fc856d8-1de9-4743-a0ae-135184ccc73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:27.304718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1125/2252] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:27.309682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc856d8-1de9-4743-a0ae-135184ccc73f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.319015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc856d8-1de9-4743-a0ae-135184ccc73f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:27.323850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:27.324470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.324751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.325024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.325669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:27.325969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:27.327653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.339172 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1126/2253] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:30:27.343391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.352961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4022642-f422-4b80-94e3-f9156a599c5d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:27.358344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:27.358925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.359204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.359499 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.360104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:27.362011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.457017 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99db67ef5cc454093f2784838ede809'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.457670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99db67ef5cc454093f2784838ede809'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.470069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99db67ef5cc454093f2784838ede809'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.470700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99db67ef5cc454093f2784838ede809'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.490484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1127/2254] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:27 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:27.493955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.496544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:27.522536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99db67ef5cc454093f2784838ede809'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:27.524095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:27.538088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1128/2255] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:27 2022] DELETE /identity/v3/users/f99db67ef5cc454093f2784838ede809 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:27.571018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70741518-05c5-4f46-814a-4c38452eeded admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:27.642714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:27.644392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.644721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.644999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.645676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:27.647686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.746696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:27.756451 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1128/2256] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:27 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:27.761291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.772460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40baf7-4821-4767-930e-ddfa0075cfd7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:27.778251 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:27.778889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.779241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.779623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.780384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:27.782104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.793348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1129/2257] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:27.801340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.812635 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57bed3-86b0-4c48-8a24-910ad06c391b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:27.817695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:27.817975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.818253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.818523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.819372 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:27.820976 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.833411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1129/2258] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:27.837364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.849074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29a785-58c2-476c-b1c8-8a35726260fe admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:27.854160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2280f28-161a-4d19-96ca-94d8c64dcf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:27.854924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280f28-161a-4d19-96ca-94d8c64dcf1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.855213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280f28-161a-4d19-96ca-94d8c64dcf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.855488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2280f28-161a-4d19-96ca-94d8c64dcf1e admin admin] PATH_INFO: `/v3/projects/e4158a10ca304414ac4e5287bfd6ef96/users/50521740d39841e6852f41d3295b1fff/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.871217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2280f28-161a-4d19-96ca-94d8c64dcf1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4158a10ca304414ac4e5287bfd6ef96, user_id=50521740d39841e6852f41d3295b1fff, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:27.874050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2280f28-161a-4d19-96ca-94d8c64dcf1e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:27.970423 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1130/2259] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:27 2022] PUT /identity/v3/projects/e4158a10ca304414ac4e5287bfd6ef96/users/50521740d39841e6852f41d3295b1fff/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:27.970724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:27.972592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:27.982010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:27.982189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:27.982584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:27.989232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b55a-fb88-40f5-b651-99de73db30f1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:28.018691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] MFA Rules not processed for user `50521740d39841e6852f41d3295b1fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:28.019966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:28.057288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:28.058324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.058574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.058846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] PATH_INFO: `/v3/projects/0cb344523e8a434bada7e35666a3e698` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.060235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb344523e8a434bada7e35666a3e698)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:28.062152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:28.090257 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1131/2260] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:30:28.100988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:28.102355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:28.162014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22bda-afc0-41d2-8a27-690273ebe43e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:28.166245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5e890-a023-461d-b944-6c30322f92ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:28.167375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e890-a023-461d-b944-6c30322f92ba service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.167668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e890-a023-461d-b944-6c30322f92ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.167949 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5e890-a023-461d-b944-6c30322f92ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.177548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5e890-a023-461d-b944-6c30322f92ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:28.179071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5e890-a023-461d-b944-6c30322f92ba service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:28.188789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb344523e8a434bada7e35666a3e698', 'request_id': 'req-9bd5a62c-3f0a-469b-86fc-edb3835943f5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:28.191500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1132/2261] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:28.200892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb344523e8a434bada7e35666a3e698', 'request_id': 'req-9bd5a62c-3f0a-469b-86fc-edb3835943f5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:28.208558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb344523e8a434bada7e35666a3e698', 'request_id': 'req-9bd5a62c-3f0a-469b-86fc-edb3835943f5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:28.330721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] The token cache is being invalidate because project 0cb344523e8a434bada7e35666a3e698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:28.331027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:28.332181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9bd5a62c-3f0a-469b-86fc-edb3835943f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:28.352986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769798-b88f-45da-ac7a-46ab90b2ccd9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.353478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769798-b88f-45da-ac7a-46ab90b2ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.353966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769798-b88f-45da-ac7a-46ab90b2ccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.358003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1130/2262] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:27 2022] DELETE /identity/v3/projects/0cb344523e8a434bada7e35666a3e698 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:28.383785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e9769798-b88f-45da-ac7a-46ab90b2ccd9 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:28.386015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e9769798-b88f-45da-ac7a-46ab90b2ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:28.443556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:28.473117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1133/2263] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:28.478108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d437-f7d1-4a95-85ed-716b56239a22 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.478500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d437-f7d1-4a95-85ed-716b56239a22 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.478852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d437-f7d1-4a95-85ed-716b56239a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.500136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0b87d437-f7d1-4a95-85ed-716b56239a22 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:28.501397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b87d437-f7d1-4a95-85ed-716b56239a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:28.509473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1131/2264] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:28.514532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9769798-b88f-45da-ac7a-46ab90b2ccd9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:28.524465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9769798-b88f-45da-ac7a-46ab90b2ccd9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:28.530459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:28.531070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.531346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.531641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.532470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:28.532870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:28.534450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:28.548227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1134/2265] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:28.552773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d437-f7d1-4a95-85ed-716b56239a22 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:28.565119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d437-f7d1-4a95-85ed-716b56239a22 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:28.570693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:28.571777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.572063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.572485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.573762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:28.576398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:28.702218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1132/2266] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:28 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:28.706417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:28.718341 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525070-ad34-4fbd-bb67-c56e3990488b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:28.779662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:28.780486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.780766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.781035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.781667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:28.783756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:28.909083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1135/2267] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:28 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:28.913232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:28.923766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c91e3-85d2-43aa-8b8c-a1200444f45e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:28.928694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:28.929307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.929585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.929863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.930543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:28.932757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:28.943016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1133/2268] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:28.947259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:28.958832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf7315-5d03-40f3-a25d-4a111f94579d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:28.963674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26389a0b-e764-40c6-a43e-c258ba5f39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:28.964310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26389a0b-e764-40c6-a43e-c258ba5f39a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:28.964641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26389a0b-e764-40c6-a43e-c258ba5f39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:28.964914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26389a0b-e764-40c6-a43e-c258ba5f39a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:28.965555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26389a0b-e764-40c6-a43e-c258ba5f39a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:28.967192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26389a0b-e764-40c6-a43e-c258ba5f39a8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:28.978495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1136/2269] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:28.983007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:29.008376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ee2e2-97b0-4e32-8249-7500a5a32a4e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:29.014007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:29.014671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:29.014953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:29.015229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] PATH_INFO: `/v3/projects/54b67231c062403fb81d64a28c012eee/users/f6b68c05d7bc4a9391c3cf69c61ca776/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:29.031495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b67231c062403fb81d64a28c012eee, user_id=f6b68c05d7bc4a9391c3cf69c61ca776, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:29.034435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:29.137765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1134/2270] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:28 2022] PUT /identity/v3/projects/54b67231c062403fb81d64a28c012eee/users/f6b68c05d7bc4a9391c3cf69c61ca776/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:30:29.142993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0782e-1209-4255-a71f-fd4692b8013b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:29.143356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0782e-1209-4255-a71f-fd4692b8013b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:29.143748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0782e-1209-4255-a71f-fd4692b8013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:29.172622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a0b0782e-1209-4255-a71f-fd4692b8013b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:29.173857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a0b0782e-1209-4255-a71f-fd4692b8013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:29.243364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1137/2271] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:29.258083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:29.258083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:29.271022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:29.316759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efc62c-afe3-432c-b5cd-2fae65de2698 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:29.320506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:29.321142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:29.321465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:29.321742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:29.331186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:29.332814 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:29.342843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1135/2272] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:35.813255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc920-d65f-4bd2-9a80-2817da9f066f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:35.824335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc920-d65f-4bd2-9a80-2817da9f066f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:35.824966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cc920-d65f-4bd2-9a80-2817da9f066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:35.873438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9b2cc920-d65f-4bd2-9a80-2817da9f066f None None] MFA Rules not processed for user `f6b68c05d7bc4a9391c3cf69c61ca776`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:35.875023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9b2cc920-d65f-4bd2-9a80-2817da9f066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:35.961277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:35.993170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1138/2273] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:35.998717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:36.016939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818852b5-15ad-4d9c-8e47-45d432aff408 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:36.028529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:36.030168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:36.030551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:36.030908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:36.031870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:36.034255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:36.179471 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1136/2274] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:35 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:36.185207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cc920-d65f-4bd2-9a80-2817da9f066f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:36.203811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cc920-d65f-4bd2-9a80-2817da9f066f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:36.308183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:36.308939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:36.309325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:36.310593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:36.311258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:36.317731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:36.429370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1139/2275] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:36 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:36.436468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:36.458383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1cc40-b7b8-403e-9afc-368c07b68ed4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:36.471605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:36.472408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:36.472703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:36.472984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:36.473651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:36.475354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:36.502645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1137/2276] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:36.506653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:36.523723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ee42b-04f9-464e-a645-3f3fc64c15cb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:36.532507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:36.533307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:36.534134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:36.534134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] PATH_INFO: `/v3/projects/89897c981904483e9385f33e5dc2c785/users/46de3b4e82ad4e3694acc7aa3d3e1cc5/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:36.557719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89897c981904483e9385f33e5dc2c785, user_id=46de3b4e82ad4e3694acc7aa3d3e1cc5, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:36.560707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:36.642737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1140/2277] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:36 2022] PUT /identity/v3/projects/89897c981904483e9385f33e5dc2c785/users/46de3b4e82ad4e3694acc7aa3d3e1cc5/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:36.646779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:36.663275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505270ad-d63a-4753-9809-ffb727bec1fd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:36.788546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:36.789225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:36.789519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:36.789798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:36.790500 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:36.793828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:36.818161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1138/2278] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:36.826726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:36.835320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00154e9-08ec-4f88-8d9a-f2bd842dfdf8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:36.843814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531f72c-34e0-445e-a045-c121bde4ecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:36.845122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f72c-34e0-445e-a045-c121bde4ecf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:36.845721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f72c-34e0-445e-a045-c121bde4ecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:36.846637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531f72c-34e0-445e-a045-c121bde4ecf7 admin admin] PATH_INFO: `/v3/projects/89897c981904483e9385f33e5dc2c785/users/46de3b4e82ad4e3694acc7aa3d3e1cc5/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:36.850338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531f72c-34e0-445e-a045-c121bde4ecf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89897c981904483e9385f33e5dc2c785, user_id=46de3b4e82ad4e3694acc7aa3d3e1cc5, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:36.860351 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531f72c-34e0-445e-a045-c121bde4ecf7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:36.870699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1141/2279] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:36 2022] PUT /identity/v3/projects/89897c981904483e9385f33e5dc2c785/users/46de3b4e82ad4e3694acc7aa3d3e1cc5/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:39.526251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:39.529946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:39.557140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19612-702c-4c81-845c-742e5e4903ac admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:39.680982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:39.681903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:39.682294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:39.682813 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] PATH_INFO: `/v3/users/50521740d39841e6852f41d3295b1fff` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:39.686875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50521740d39841e6852f41d3295b1fff)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:39.698380 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:39.725325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:39.970377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50521740d39841e6852f41d3295b1fff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:39.974022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50521740d39841e6852f41d3295b1fff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:40.022110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50521740d39841e6852f41d3295b1fff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:40.035125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50521740d39841e6852f41d3295b1fff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:40.042163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50521740d39841e6852f41d3295b1fff'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:40.128280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1139/2280] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:30:39 2022] DELETE /identity/v3/users/50521740d39841e6852f41d3295b1fff => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:40.131497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:40.132066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:40.132590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:40.197777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:40.201922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:40.308810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1142/2281] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:40.334211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:40.335841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:40.440470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800f32e-39d8-405f-96d1-666d4a8739e9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:40.444602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687b3dc-087e-4802-9919-ae846d05c977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:40.445240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b3dc-087e-4802-9919-ae846d05c977 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:40.445526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b3dc-087e-4802-9919-ae846d05c977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:40.445885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b3dc-087e-4802-9919-ae846d05c977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:40.457992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687b3dc-087e-4802-9919-ae846d05c977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:40.464623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687b3dc-087e-4802-9919-ae846d05c977 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:40.474987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1140/2282] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:41.558711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:41.561156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:41.583271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb18e20-65f5-4cdd-9dce-1715d2d7113d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:41.606901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:41.610880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:41.611295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:41.614627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] PATH_INFO: `/v3/projects/e4158a10ca304414ac4e5287bfd6ef96` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:41.620549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4158a10ca304414ac4e5287bfd6ef96)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:41.620549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:41.787969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:41.833591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4158a10ca304414ac4e5287bfd6ef96', 'request_id': 'req-89017187-a1c8-4cdf-a439-e3c9d7b098b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:41.860442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4158a10ca304414ac4e5287bfd6ef96', 'request_id': 'req-89017187-a1c8-4cdf-a439-e3c9d7b098b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:41.979873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4158a10ca304414ac4e5287bfd6ef96', 'request_id': 'req-89017187-a1c8-4cdf-a439-e3c9d7b098b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:42.031720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] The token cache is being invalidate because project e4158a10ca304414ac4e5287bfd6ef96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:30:42.032770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:42.033778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-89017187-a1c8-4cdf-a439-e3c9d7b098b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:30:42.039913 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1143/2283] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:41 2022] DELETE /identity/v3/projects/e4158a10ca304414ac4e5287bfd6ef96 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:42.042001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309397d-dbf2-4799-8baf-c15d4f7b8716 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.042465 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309397d-dbf2-4799-8baf-c15d4f7b8716 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.043268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309397d-dbf2-4799-8baf-c15d4f7b8716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.073950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2309397d-dbf2-4799-8baf-c15d4f7b8716 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:42.075893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2309397d-dbf2-4799-8baf-c15d4f7b8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:42.278868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1141/2284] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:42.287528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a72de-8a81-4fed-880c-095ff551bd40 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.287820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a72de-8a81-4fed-880c-095ff551bd40 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.288096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a72de-8a81-4fed-880c-095ff551bd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.320679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-122a72de-8a81-4fed-880c-095ff551bd40 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:42.322415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-122a72de-8a81-4fed-880c-095ff551bd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:42.334032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1144/2285] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:42.339459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309397d-dbf2-4799-8baf-c15d4f7b8716 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:42.352589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309397d-dbf2-4799-8baf-c15d4f7b8716 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:42.359821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:42.361275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.361745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.363256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.363256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:30:42.363706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:42.365702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:42.391310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a72de-8a81-4fed-880c-095ff551bd40 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:42.398178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1142/2286] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:30:42.404643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a72de-8a81-4fed-880c-095ff551bd40 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:42.410593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:42.411724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.412442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.414878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.414878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:42.416119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:42.536478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1145/2287] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:30:42 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:30:42.539705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:42.552623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810fe0-17ab-4404-93b9-952d2d842e0b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:42.595705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:42.632875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:42.633657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.634039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.635034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.636075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:42.638511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:42.752240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1143/2288] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:30:42 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:30:42.755945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:42.767902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da29f-3b09-4984-b3c1-e7bbe97281ec admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:42.773181 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:42.774381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.774767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.775145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.776604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:42.778303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:42.801792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1146/2289] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:42.805674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:42.827826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2612ee-4560-41e4-b48d-1d92d96d6956 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:42.833900 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f37d1-0da6-4090-8a47-9bb637290422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:42.834737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f37d1-0da6-4090-8a47-9bb637290422 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.835079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f37d1-0da6-4090-8a47-9bb637290422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.835425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f37d1-0da6-4090-8a47-9bb637290422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.836148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f37d1-0da6-4090-8a47-9bb637290422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:42.838482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f37d1-0da6-4090-8a47-9bb637290422 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:42.855395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1144/2290] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:30:42.863235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:42.875572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefc95d-1a81-4948-a96f-090075c4530f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:42.882543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:42.883747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.884040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.884362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] PATH_INFO: `/v3/projects/8db495411fa7471ab21a5e44950b362a/users/7e93aa56f0554e8c8570241b8b9f7e52/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:42.908943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db495411fa7471ab21a5e44950b362a, user_id=7e93aa56f0554e8c8570241b8b9f7e52, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:42.912789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:42.971204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1147/2291] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:30:42 2022] PUT /identity/v3/projects/8db495411fa7471ab21a5e44950b362a/users/7e93aa56f0554e8c8570241b8b9f7e52/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:30:42.982968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a1293-5ddc-4c9e-a243-cacca502af9b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:42.983714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a1293-5ddc-4c9e-a243-cacca502af9b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:42.984703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a1293-5ddc-4c9e-a243-cacca502af9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:43.137634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d61a1293-5ddc-4c9e-a243-cacca502af9b None None] MFA Rules not processed for user `7e93aa56f0554e8c8570241b8b9f7e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:43.145182 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d61a1293-5ddc-4c9e-a243-cacca502af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:43.397766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1145/2292] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:43.425839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:43.427594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:43.600977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac22f2e-fa47-4d9d-b6d6-00c693675978 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:43.614154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514818f5b23c4234b259e5b47e698a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:43.617833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:43.619809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:43.620442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:43.637062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:43.640493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:43.651808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1148/2293] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:30:45.616779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0214c-4ed5-4b0e-b12c-eeaa3ebd50b5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:45.617275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0214c-4ed5-4b0e-b12c-eeaa3ebd50b5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:45.617391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0214c-4ed5-4b0e-b12c-eeaa3ebd50b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:45.649460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9ea0214c-4ed5-4b0e-b12c-eeaa3ebd50b5 None None] MFA Rules not processed for user `46de3b4e82ad4e3694acc7aa3d3e1cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:45.650712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9ea0214c-4ed5-4b0e-b12c-eeaa3ebd50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:45.730699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1146/2294] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:45.745029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:30:45.746539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:45.808620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:45.827693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f303197-ef5d-4839-9f7a-2a993584a92d service glance] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:30:45.832640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b850510-f361-4097-b7e3-088e2dedd1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:30:45.833249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b850510-f361-4097-b7e3-088e2dedd1c1 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:45.833529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b850510-f361-4097-b7e3-088e2dedd1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:45.833802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b850510-f361-4097-b7e3-088e2dedd1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:45.835626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6b850510-f361-4097-b7e3-088e2dedd1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:45.903150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b850510-f361-4097-b7e3-088e2dedd1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:30:45.905034 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b850510-f361-4097-b7e3-088e2dedd1c1 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:30:45.916498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1149/2295] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:30:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:30:48.761915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:48.761915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:48.761915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:48.781467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] MFA Rules not processed for user `f6b68c05d7bc4a9391c3cf69c61ca776`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:48.782922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:48.799713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1147/2296] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:30:55.956131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=30 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:58.758455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386479ad-4859-48f5-a507-825ef306076e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:30:58.759080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386479ad-4859-48f5-a507-825ef306076e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:30:58.759080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386479ad-4859-48f5-a507-825ef306076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:30:58.775218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:58.778429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-386479ad-4859-48f5-a507-825ef306076e None None] MFA Rules not processed for user `79e1333fbbee4656ad73e5b1c3203bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:30:58.779749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-386479ad-4859-48f5-a507-825ef306076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:30:58.841123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1150/2297] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:04.113647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:04.115054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:04.180594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39ad49-2c9c-4598-a030-a3f9065b60b7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:04.185420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:04.186049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:04.186324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:04.186633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] PATH_INFO: `/v3/users/cbaafc5331d0405f85be84e40fe500d2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:04.187772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbaafc5331d0405f85be84e40fe500d2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:04.189674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:04.418216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbaafc5331d0405f85be84e40fe500d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:04.419020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbaafc5331d0405f85be84e40fe500d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:04.430965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbaafc5331d0405f85be84e40fe500d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:04.438007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbaafc5331d0405f85be84e40fe500d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:04.438748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbaafc5331d0405f85be84e40fe500d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:04.544315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1148/2298] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:31:04 2022] DELETE /identity/v3/users/cbaafc5331d0405f85be84e40fe500d2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:04.549016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:04.549460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:04.549585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:04.569409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:04.570602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:04.638253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1151/2299] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:04.644921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:04.646569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:04.731647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdde4ff-5ee2-403e-94c2-00163c6e4de3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:04.735155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbc496-73f8-4e3a-a44d-69d31b95d0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:04.735739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbc496-73f8-4e3a-a44d-69d31b95d0ec service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:04.736016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbc496-73f8-4e3a-a44d-69d31b95d0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:04.736374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbc496-73f8-4e3a-a44d-69d31b95d0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:04.745331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbc496-73f8-4e3a-a44d-69d31b95d0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:04.747094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbc496-73f8-4e3a-a44d-69d31b95d0ec service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:04.757062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1149/2300] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:05.157435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:05.160896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:05.172168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b7e3d-7bba-4c1f-968e-ae092f94dcc3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:05.177286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:05.177953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.178299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.178661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] PATH_INFO: `/v3/projects/d6c2965a04044a449f256a18f345b3a5` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.180330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c2965a04044a449f256a18f345b3a5)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:05.182505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:05.284029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c2965a04044a449f256a18f345b3a5', 'request_id': 'req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:05.290183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c2965a04044a449f256a18f345b3a5', 'request_id': 'req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:05.344192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c2965a04044a449f256a18f345b3a5', 'request_id': 'req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:05.356771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] The token cache is being invalidate because project d6c2965a04044a449f256a18f345b3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:31:05.357064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:05.357688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43a3ac50-e8d4-4e4f-8570-3b3123c2e786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:05.359152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1152/2301] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:05 2022] DELETE /identity/v3/projects/d6c2965a04044a449f256a18f345b3a5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:31:05.364288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd728-d392-4ff4-bf7d-7fd6d9895d90 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.364914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd728-d392-4ff4-bf7d-7fd6d9895d90 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.365001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd728-d392-4ff4-bf7d-7fd6d9895d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.385608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-763fd728-d392-4ff4-bf7d-7fd6d9895d90 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:05.387665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-763fd728-d392-4ff4-bf7d-7fd6d9895d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:05.405624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:05.450572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1150/2302] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:05.459405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ea0f-f0f9-4650-9e4f-bff8b259cfd9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.459697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ea0f-f0f9-4650-9e4f-bff8b259cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.459976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312ea0f-f0f9-4650-9e4f-bff8b259cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.480831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1312ea0f-f0f9-4650-9e4f-bff8b259cfd9 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:05.482100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1312ea0f-f0f9-4650-9e4f-bff8b259cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:05.490566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1153/2303] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:05.494789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fd728-d392-4ff4-bf7d-7fd6d9895d90 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:05.504568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fd728-d392-4ff4-bf7d-7fd6d9895d90 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:05.509322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:05.509920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.510203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.510476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.511670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:31:05.511984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:05.513621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:05.526444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1151/2304] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:31:05.531492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312ea0f-f0f9-4650-9e4f-bff8b259cfd9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:05.540841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312ea0f-f0f9-4650-9e4f-bff8b259cfd9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:05.545982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:05.546584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.546865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.547137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.547773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:05.549765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:05.637968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:05.644637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1154/2305] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:05.649189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:05.660272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d54115-4cd3-4de7-a4c4-185da32d9bba admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:05.730366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:05.731344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.731629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.731908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.732591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:05.734892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:05.848682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1152/2306] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:31:05 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:31:05.854977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:05.869095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde7b8-0bef-4e6f-84be-8f5ec8d3d2c9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:05.874562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:05.875268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.875643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.875937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.876664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:05.878378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:05.890316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1155/2307] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:05.894561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:05.904707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0973b3f-cb0c-495e-ad72-10a74b5d8553 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:05.909446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bea3b9-ea51-4424-8513-f884fec60d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:05.910052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea3b9-ea51-4424-8513-f884fec60d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.910349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea3b9-ea51-4424-8513-f884fec60d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.910612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea3b9-ea51-4424-8513-f884fec60d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.911258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bea3b9-ea51-4424-8513-f884fec60d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:05.912937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bea3b9-ea51-4424-8513-f884fec60d59 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:05.924723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1153/2308] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:05.929103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:05.940107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949710-e978-410e-9438-9aefa2550594 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:05.944944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:05.945607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:05.945892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:05.946184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] PATH_INFO: `/v3/projects/918a94cb6c9d44a0b483b39bd19c54da/users/a0a8d082773543c5942d7485b92fa601/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:05.976044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918a94cb6c9d44a0b483b39bd19c54da, user_id=a0a8d082773543c5942d7485b92fa601, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:05.978936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:06.077777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1156/2309] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:31:05 2022] PUT /identity/v3/projects/918a94cb6c9d44a0b483b39bd19c54da/users/a0a8d082773543c5942d7485b92fa601/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:06.084702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a28f8-dc6c-48c8-8674-183aa72d1964 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:06.085005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a28f8-dc6c-48c8-8674-183aa72d1964 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:06.085287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a28f8-dc6c-48c8-8674-183aa72d1964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:06.105704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cb3a28f8-dc6c-48c8-8674-183aa72d1964 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:06.106931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb3a28f8-dc6c-48c8-8674-183aa72d1964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:06.169007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1154/2310] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:06.178884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:06.180887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:06.242134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c4c4-b3de-4b01-b30e-21946afe9340 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:06.249776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:06.249776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:06.249776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:06.249776 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:06.256644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:06.258057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:06.268220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1157/2311] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:31:07.712383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c67cc-a5f5-49a6-a892-a537cfb4358c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:07.717992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c67cc-a5f5-49a6-a892-a537cfb4358c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:07.717992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c67cc-a5f5-49a6-a892-a537cfb4358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:07.751592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e89c67cc-a5f5-49a6-a892-a537cfb4358c None None] MFA Rules not processed for user `a0a8d082773543c5942d7485b92fa601`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:07.753846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e89c67cc-a5f5-49a6-a892-a537cfb4358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:07.776629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:07.848903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1155/2312] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:07.862794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:07.865164 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:07.957069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8791b-6e23-42d9-8f22-24b58faabd4c service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:07.963322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:07.964493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:07.964493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:07.964790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:07.975944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:07.977848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:07.988911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1158/2313] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:11.001093 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e1fc6-fb20-4331-98f4-ccc307b8f865 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:11.001595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e1fc6-fb20-4331-98f4-ccc307b8f865 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:11.001877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e1fc6-fb20-4331-98f4-ccc307b8f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:11.025011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6b7e1fc6-fb20-4331-98f4-ccc307b8f865 None None] MFA Rules not processed for user `a0a8d082773543c5942d7485b92fa601`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:11.026211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6b7e1fc6-fb20-4331-98f4-ccc307b8f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:11.034273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1156/2314] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:15.984610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:15.986093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:16.000953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe010f-04d2-472f-b14b-6a3e8c62f309 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:16.005637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:16.006265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:16.006548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:16.006826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] PATH_INFO: `/v3/users/8896bc4661114244b31b785005ea1483` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:16.008018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8896bc4661114244b31b785005ea1483)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:16.010241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:16.200614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8896bc4661114244b31b785005ea1483'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:16.201557 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8896bc4661114244b31b785005ea1483'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:16.219128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8896bc4661114244b31b785005ea1483'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:16.219854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8896bc4661114244b31b785005ea1483'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:16.221957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:16.315419 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8896bc4661114244b31b785005ea1483'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:16.332065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1159/2315] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:31:15 2022] DELETE /identity/v3/users/8896bc4661114244b31b785005ea1483 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:16.336696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:16.337306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:16.337306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:16.357997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:16.359295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:16.420518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1157/2316] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:16.430182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:16.431610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:16.497747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa19604-9603-4929-b4ab-5dce569991a4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:16.502245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d6856-ccf2-416f-8801-bff36dfdae6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:16.502958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6856-ccf2-416f-8801-bff36dfdae6b service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:16.503370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6856-ccf2-416f-8801-bff36dfdae6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:16.503775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d6856-ccf2-416f-8801-bff36dfdae6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:16.515036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6856-ccf2-416f-8801-bff36dfdae6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:16.530157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d6856-ccf2-416f-8801-bff36dfdae6b service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:16.530157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1160/2317] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:16.957891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:16.959351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:16.972665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da07c95-d642-4d64-9769-e2d99aa05eb6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:16.977648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:16.978289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:16.978577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:16.978853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] PATH_INFO: `/v3/projects/1a0ce17ec19844aa95057cdf13a0aead` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:16.979994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0ce17ec19844aa95057cdf13a0aead)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:16.982661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:17.094525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0ce17ec19844aa95057cdf13a0aead', 'request_id': 'req-caae25e9-c2d4-44ca-ac41-e00f8c358817'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:17.099947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0ce17ec19844aa95057cdf13a0aead', 'request_id': 'req-caae25e9-c2d4-44ca-ac41-e00f8c358817'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:17.106151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0ce17ec19844aa95057cdf13a0aead', 'request_id': 'req-caae25e9-c2d4-44ca-ac41-e00f8c358817'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:17.178154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] The token cache is being invalidate because project 1a0ce17ec19844aa95057cdf13a0aead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:31:17.178392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:17.179034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-caae25e9-c2d4-44ca-ac41-e00f8c358817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:17.180602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1158/2318] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:16 2022] DELETE /identity/v3/projects/1a0ce17ec19844aa95057cdf13a0aead => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:17.185775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af11f-554c-432b-b88d-a9185528855a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.186271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af11f-554c-432b-b88d-a9185528855a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.186405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af11f-554c-432b-b88d-a9185528855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.206261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bb0af11f-554c-432b-b88d-a9185528855a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:17.207463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bb0af11f-554c-432b-b88d-a9185528855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:17.271798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1161/2319] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:17.281789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3a80-74bb-4477-9691-614705ce4b11 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.282077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3a80-74bb-4477-9691-614705ce4b11 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.282361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3a80-74bb-4477-9691-614705ce4b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.302585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dc0e3a80-74bb-4477-9691-614705ce4b11 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:17.303807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dc0e3a80-74bb-4477-9691-614705ce4b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:17.312642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1159/2320] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:17.317070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0af11f-554c-432b-b88d-a9185528855a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:17.327965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0af11f-554c-432b-b88d-a9185528855a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:17.334615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:17.342027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.342027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.342027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.342027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:31:17.342027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:17.342027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:17.351401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1162/2321] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:31:17.355875 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3a80-74bb-4477-9691-614705ce4b11 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:17.365432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3a80-74bb-4477-9691-614705ce4b11 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:17.370129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:17.370727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.371010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.371279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.371898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:17.373862 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:17.448891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1160/2322] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:31:17 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:17.455279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:17.468646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155fab5-3d1c-4480-aea9-cfe2a1cc1ded admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:17.528328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:17.529568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.530077 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.530347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.530971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:17.532910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:17.607370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1163/2323] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:31:17 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:17.611513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:17.621975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefb58-521d-4696-aa0d-f6761b8ed4dd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:17.627481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:17.628066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.628507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.628787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.629424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:17.631007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:17.632375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:17.643289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1161/2324] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:17.647524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:17.653166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:17.658926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24246dae-e44e-4d05-8ae6-e12e029a6029 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:17.664974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a5f58-f5a4-480b-bb00-c242c3ad43ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:17.665675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5f58-f5a4-480b-bb00-c242c3ad43ad admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.666066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5f58-f5a4-480b-bb00-c242c3ad43ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.666432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5f58-f5a4-480b-bb00-c242c3ad43ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.667171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5f58-f5a4-480b-bb00-c242c3ad43ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:17.669137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a5f58-f5a4-480b-bb00-c242c3ad43ad admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:17.680501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1164/2325] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:17.694283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:17.695666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15ec10-9e02-41ff-b77b-4168c4051979 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:17.700526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:17.701774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.702066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.702322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] PATH_INFO: `/v3/projects/33d1ab78490448899a13aee6aa2818f6/users/bd999b90158a4719a00d6615634c5723/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.717781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d1ab78490448899a13aee6aa2818f6, user_id=bd999b90158a4719a00d6615634c5723, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:17.720819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:17.795961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1162/2326] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:31:17 2022] PUT /identity/v3/projects/33d1ab78490448899a13aee6aa2818f6/users/bd999b90158a4719a00d6615634c5723/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:17.806477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f053e-d18e-437c-9cdf-36b407ab53fc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.806787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f053e-d18e-437c-9cdf-36b407ab53fc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.807063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f053e-d18e-437c-9cdf-36b407ab53fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:17.836378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6e3f053e-d18e-437c-9cdf-36b407ab53fc None None] MFA Rules not processed for user `bd999b90158a4719a00d6615634c5723`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:17.837616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6e3f053e-d18e-437c-9cdf-36b407ab53fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:17.908810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1165/2327] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:17.922852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:17.925006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:17.986957 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58bbe3-9df3-4ac8-bb7a-be2034ada430 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:17.990747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c1800-89ce-40b9-822f-56bfb8ec81b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:17.991374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1800-89ce-40b9-822f-56bfb8ec81b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:17.991656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1800-89ce-40b9-822f-56bfb8ec81b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:17.991929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c1800-89ce-40b9-822f-56bfb8ec81b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:18.001977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c1800-89ce-40b9-822f-56bfb8ec81b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:18.003412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c1800-89ce-40b9-822f-56bfb8ec81b0 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:18.015575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1163/2328] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:22.167323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f053e-d18e-437c-9cdf-36b407ab53fc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:22.255871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f053e-d18e-437c-9cdf-36b407ab53fc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:22.264295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:22.266866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:22.266866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:22.266866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] PATH_INFO: `/v3/users/bd999b90158a4719a00d6615634c5723` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:22.266866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd999b90158a4719a00d6615634c5723)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:22.269346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:22.473022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd999b90158a4719a00d6615634c5723'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:22.473752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd999b90158a4719a00d6615634c5723'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:22.488359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd999b90158a4719a00d6615634c5723'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:22.488359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd999b90158a4719a00d6615634c5723'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:22.537441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd999b90158a4719a00d6615634c5723'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:22.546892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:22.551158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1166/2329] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:31:22 2022] DELETE /identity/v3/users/bd999b90158a4719a00d6615634c5723 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:22.555590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:22.556051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:22.556161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:22.575805 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:22.577128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:22.637535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1164/2330] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:22.648897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:22.650263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:22.728265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5e117-98f9-4dcf-87c2-ad816967fc52 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:22.744763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0219790-3224-4e93-ac63-35fac44889db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:22.745465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219790-3224-4e93-ac63-35fac44889db service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:22.745877 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219790-3224-4e93-ac63-35fac44889db service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:22.746292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0219790-3224-4e93-ac63-35fac44889db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:22.759275 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0219790-3224-4e93-ac63-35fac44889db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:22.761113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0219790-3224-4e93-ac63-35fac44889db service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:22.776543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1167/2331] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:23.175124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:23.176902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:23.190159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046913a-b178-47f3-9bf6-498bb7e3159e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:23.195967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:23.197984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:23.197984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:23.197984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] PATH_INFO: `/v3/projects/33d1ab78490448899a13aee6aa2818f6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:23.198877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d1ab78490448899a13aee6aa2818f6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:23.201469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:23.339656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d1ab78490448899a13aee6aa2818f6', 'request_id': 'req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:23.345704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d1ab78490448899a13aee6aa2818f6', 'request_id': 'req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:23.352638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d1ab78490448899a13aee6aa2818f6', 'request_id': 'req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:23.443540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:23.451210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] The token cache is being invalidate because project 33d1ab78490448899a13aee6aa2818f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:31:23.451711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:23.452740 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:23.454539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1165/2332] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:23 2022] DELETE /identity/v3/projects/33d1ab78490448899a13aee6aa2818f6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:32.784245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=26 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:33.725937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:35.238142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:35.238716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:35.238716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:35.260390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:35.261572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:35.327002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1168/2333] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:35.359484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:35.361418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:35.495644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1719d0-9cc0-4e6e-9ef1-4842fe6c37f6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:35.502661 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63d42-07ff-4545-82e0-7310ef840bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:35.503277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63d42-07ff-4545-82e0-7310ef840bf7 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:35.503561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63d42-07ff-4545-82e0-7310ef840bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:35.503832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63d42-07ff-4545-82e0-7310ef840bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:35.514079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63d42-07ff-4545-82e0-7310ef840bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:35.515718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63d42-07ff-4545-82e0-7310ef840bf7 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:35.528551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1166/2334] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:36.967476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:36.968920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:36.980842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9a8e-aceb-4a49-b5ff-f67377fa0c6a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:36.985618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:36.986259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:36.986550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:36.986824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] PATH_INFO: `/v3/users/7e93aa56f0554e8c8570241b8b9f7e52` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:36.987969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e93aa56f0554e8c8570241b8b9f7e52)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:36.993286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:37.168371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e93aa56f0554e8c8570241b8b9f7e52'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:37.169255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e93aa56f0554e8c8570241b8b9f7e52'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:37.181916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e93aa56f0554e8c8570241b8b9f7e52'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:37.182659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e93aa56f0554e8c8570241b8b9f7e52'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:37.246038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e93aa56f0554e8c8570241b8b9f7e52'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:37.259856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1169/2335] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:31:36 2022] DELETE /identity/v3/users/7e93aa56f0554e8c8570241b8b9f7e52 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:37.268697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:37.269184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:37.269389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:37.289787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:37.291000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:37.358945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1167/2336] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:37.370226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:37.371894 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:37.440420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958652f-6c7c-497e-9b39-76404044b521 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:37.444241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2396ac-e042-4f2b-b172-586238f668fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:37.444965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2396ac-e042-4f2b-b172-586238f668fb service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:37.445340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2396ac-e042-4f2b-b172-586238f668fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:37.445581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2396ac-e042-4f2b-b172-586238f668fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:37.457409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2396ac-e042-4f2b-b172-586238f668fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:37.459394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2396ac-e042-4f2b-b172-586238f668fb service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:37.472018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1170/2337] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:37.913767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:37.915326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:37.932722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc489b8a-99b1-4039-932e-9f4588881647 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:37.941300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:37.941300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:37.941300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:37.941300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] PATH_INFO: `/v3/projects/8db495411fa7471ab21a5e44950b362a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:37.941874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db495411fa7471ab21a5e44950b362a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:37.942232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:38.049213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db495411fa7471ab21a5e44950b362a', 'request_id': 'req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:38.055296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db495411fa7471ab21a5e44950b362a', 'request_id': 'req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:38.062082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db495411fa7471ab21a5e44950b362a', 'request_id': 'req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:38.131404 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] The token cache is being invalidate because project 8db495411fa7471ab21a5e44950b362a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:31:38.131695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:38.132361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4ae26d2-0979-4529-aa45-c7fbd3ac031a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:38.134126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1168/2338] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:37 2022] DELETE /identity/v3/projects/8db495411fa7471ab21a5e44950b362a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:38.139211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1f93-e5ea-4d62-8fc7-415107318a01 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.139728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1f93-e5ea-4d62-8fc7-415107318a01 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.139824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1f93-e5ea-4d62-8fc7-415107318a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.160766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e20c1f93-e5ea-4d62-8fc7-415107318a01 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:38.162738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e20c1f93-e5ea-4d62-8fc7-415107318a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:38.173832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:38.229070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1171/2339] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:38.237074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3f44-45bf-48c4-9a43-72e93314a85f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.237529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3f44-45bf-48c4-9a43-72e93314a85f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.237845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba3f44-45bf-48c4-9a43-72e93314a85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.259820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-70ba3f44-45bf-48c4-9a43-72e93314a85f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:38.261079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-70ba3f44-45bf-48c4-9a43-72e93314a85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:38.270152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1169/2340] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:38.274581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1f93-e5ea-4d62-8fc7-415107318a01 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:38.285298 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1f93-e5ea-4d62-8fc7-415107318a01 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:38.289839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:38.290465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.291036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.291495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.292604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:31:38.295589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:38.295589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:38.306434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1172/2341] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:31:38.311024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba3f44-45bf-48c4-9a43-72e93314a85f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:38.316785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:38.323386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba3f44-45bf-48c4-9a43-72e93314a85f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:38.330004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:38.330742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.331101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.331489 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.332340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:38.334941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:38.442619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1170/2342] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:31:38 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:38.446999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:38.457767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da62b3-d031-4789-ba8c-b07d2c768f9e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:38.519529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:38.520160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.520480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.520757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.521402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:38.523331 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:38.607787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1173/2343] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:31:38 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:38.614746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:38.626168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f8ab-2dc7-4ecf-b623-8017f92190bc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:38.631941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:38.632681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.633221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.633503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.634157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:38.635840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:38.647572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1171/2344] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:38.652002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:38.662594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef13bc8-fa2b-4b83-8e2e-23c21440c1ed admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:38.667506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4291c0-628b-4aca-91fa-6b173fb9bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:38.668128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4291c0-628b-4aca-91fa-6b173fb9bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.668620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4291c0-628b-4aca-91fa-6b173fb9bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.668932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4291c0-628b-4aca-91fa-6b173fb9bff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.669593 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4291c0-628b-4aca-91fa-6b173fb9bff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:38.671201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4291c0-628b-4aca-91fa-6b173fb9bff4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:38.683831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1174/2345] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:31:38.688059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:38.698394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bc9d-fd51-41b2-bea8-54fa5f9f878a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:38.703959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:38.704664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.709605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.709605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] PATH_INFO: `/v3/projects/0fa19f1537844dbfa8deab0687b18593/users/a1ce120814ec4c9f8b97c90fc5d1d3fd/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.720727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa19f1537844dbfa8deab0687b18593, user_id=a1ce120814ec4c9f8b97c90fc5d1d3fd, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:38.723405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:38.789748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1172/2346] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:31:38 2022] PUT /identity/v3/projects/0fa19f1537844dbfa8deab0687b18593/users/a1ce120814ec4c9f8b97c90fc5d1d3fd/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:38.802893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88e82-940a-4e15-bd22-9c9a9d6742a8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.803185 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88e82-940a-4e15-bd22-9c9a9d6742a8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.803462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88e82-940a-4e15-bd22-9c9a9d6742a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:38.834214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-72b88e82-940a-4e15-bd22-9c9a9d6742a8 None None] MFA Rules not processed for user `a1ce120814ec4c9f8b97c90fc5d1d3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:38.835449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-72b88e82-940a-4e15-bd22-9c9a9d6742a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:38.908822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1175/2347] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:38.920732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:38.922562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:38.985434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c499-a56c-48c1-a0b3-7e59052a4952 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:38.989269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf67c9-a904-4862-8acc-833c37663bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:38.989890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf67c9-a904-4862-8acc-833c37663bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:38.990200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf67c9-a904-4862-8acc-833c37663bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:38.990478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf67c9-a904-4862-8acc-833c37663bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:39.000426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf67c9-a904-4862-8acc-833c37663bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:39.002492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf67c9-a904-4862-8acc-833c37663bc9 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:39.013161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1173/2348] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:39.038174 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88e82-940a-4e15-bd22-9c9a9d6742a8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:39.051751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:39.102551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88e82-940a-4e15-bd22-9c9a9d6742a8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:39.107832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:39.108471 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:39.108751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:39.109025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] PATH_INFO: `/v3/users/a1ce120814ec4c9f8b97c90fc5d1d3fd` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:39.110163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ce120814ec4c9f8b97c90fc5d1d3fd)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:39.112073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:39.283416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ce120814ec4c9f8b97c90fc5d1d3fd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:39.284096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ce120814ec4c9f8b97c90fc5d1d3fd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:39.297202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ce120814ec4c9f8b97c90fc5d1d3fd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:39.297901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ce120814ec4c9f8b97c90fc5d1d3fd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:39.348536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ce120814ec4c9f8b97c90fc5d1d3fd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:39.362266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1176/2349] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:31:39 2022] DELETE /identity/v3/users/a1ce120814ec4c9f8b97c90fc5d1d3fd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:39.366948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:39.367466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:39.367574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:39.386630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:39.388051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:39.447870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1174/2350] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:39.458050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:39.459478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:39.519265 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e8e1-a062-4387-a646-4902bd6efa11 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:39.523365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84e99-1897-44f0-9040-70ab457faa79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:39.524041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84e99-1897-44f0-9040-70ab457faa79 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:39.524417 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84e99-1897-44f0-9040-70ab457faa79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:39.524754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84e99-1897-44f0-9040-70ab457faa79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:39.537820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84e99-1897-44f0-9040-70ab457faa79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:39.539303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84e99-1897-44f0-9040-70ab457faa79 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:39.550661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1177/2351] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:39.951055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:39.952901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:39.987285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60aed6-9474-44ea-a7c1-f11f95b70f72 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:39.995347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:39.995683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:39.995970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:39.996436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] PATH_INFO: `/v3/projects/0fa19f1537844dbfa8deab0687b18593` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:39.997856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa19f1537844dbfa8deab0687b18593)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:39.999836 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:40.204770 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:40.211732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa19f1537844dbfa8deab0687b18593', 'request_id': 'req-9b16e56a-494f-4a42-a65b-46291f377451'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:40.217733 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa19f1537844dbfa8deab0687b18593', 'request_id': 'req-9b16e56a-494f-4a42-a65b-46291f377451'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:40.225560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa19f1537844dbfa8deab0687b18593', 'request_id': 'req-9b16e56a-494f-4a42-a65b-46291f377451'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:40.302749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] The token cache is being invalidate because project 0fa19f1537844dbfa8deab0687b18593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:31:40.303040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:40.303663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16e56a-494f-4a42-a65b-46291f377451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:40.305580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1175/2352] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:39 2022] DELETE /identity/v3/projects/0fa19f1537844dbfa8deab0687b18593 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:40.310594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6e21-51f5-4b93-9ca4-c0bce7b34d3b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:40.311079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6e21-51f5-4b93-9ca4-c0bce7b34d3b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:40.311175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6e21-51f5-4b93-9ca4-c0bce7b34d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:40.331457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c01b6e21-51f5-4b93-9ca4-c0bce7b34d3b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:40.332723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c01b6e21-51f5-4b93-9ca4-c0bce7b34d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:40.361753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:40.392864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1178/2353] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:31:40.400433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027030-d43a-4932-9938-d6df6bfe81ee None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:40.400922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027030-d43a-4932-9938-d6df6bfe81ee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:40.401018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea027030-d43a-4932-9938-d6df6bfe81ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:40.421089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ea027030-d43a-4932-9938-d6df6bfe81ee None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:40.422286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ea027030-d43a-4932-9938-d6df6bfe81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:40.430353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1176/2354] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:40.436668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b6e21-51f5-4b93-9ca4-c0bce7b34d3b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:40.446592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b6e21-51f5-4b93-9ca4-c0bce7b34d3b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:40.451482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:40.452440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:40.452778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:40.453051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:40.453699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:31:40.454005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:40.455596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:40.467722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1179/2355] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:31:40.472144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea027030-d43a-4932-9938-d6df6bfe81ee None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:40.483054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea027030-d43a-4932-9938-d6df6bfe81ee None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:40.487994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:40.488709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:40.488993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:40.489270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:40.489933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:40.491942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:40.779690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1177/2356] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:31:40 2022] POST /identity/v3/projects => generated 373 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:40.783758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:40.798308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309707-3fcc-43d4-851e-c43a5cf24552 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:40.892014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:40.892874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:40.893238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:40.893592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:40.894382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:40.896722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:41.000664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:41.003263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1180/2357] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:31:40 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:31:41.014703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bae404-b55e-4034-9807-18c4863c9811 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:41.018576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:41.019333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:41.019705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:41.020180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:41.020975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:41.023008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:41.037717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1178/2358] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:31:41.042712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:41.057238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102c217-a485-47a9-9c49-4a009893af50 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:41.062393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65329a42-a28d-4e61-8621-1fd08d9f53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:41.066421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329a42-a28d-4e61-8621-1fd08d9f53fd admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:41.066421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329a42-a28d-4e61-8621-1fd08d9f53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:41.066421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329a42-a28d-4e61-8621-1fd08d9f53fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:41.066421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65329a42-a28d-4e61-8621-1fd08d9f53fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:41.066421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65329a42-a28d-4e61-8621-1fd08d9f53fd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:41.077742 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1181/2359] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:41.082009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:41.095427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca99e7-f3af-4dd8-afdf-cd7df0a6e364 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:41.101045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:41.101845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:41.102823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:41.102823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] PATH_INFO: `/v3/projects/00f6d709ca63437691291cd79c65f459/users/2e6a8d4e589642178641051ca5396dc6/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:41.123049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f6d709ca63437691291cd79c65f459, user_id=2e6a8d4e589642178641051ca5396dc6, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:41.126659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:41.202358 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1179/2360] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:31:41 2022] PUT /identity/v3/projects/00f6d709ca63437691291cd79c65f459/users/2e6a8d4e589642178641051ca5396dc6/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:31:41.205210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf26ce-4500-4d50-952f-1607644ab960 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:41.206210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf26ce-4500-4d50-952f-1607644ab960 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:41.207499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf26ce-4500-4d50-952f-1607644ab960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:41.260356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a0cf26ce-4500-4d50-952f-1607644ab960 None None] MFA Rules not processed for user `2e6a8d4e589642178641051ca5396dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:41.263470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a0cf26ce-4500-4d50-952f-1607644ab960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:41.412059 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1182/2361] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:41.414493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:41.418778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:41.499209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26d9c-3925-4d2e-bb87-a340e1c70ba8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:41.517226 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:41.519266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:41.519775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:41.520285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:41.531901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:41.533600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:41.545780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1180/2362] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:31:42.647602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:42.648066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:42.648466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:42.671911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:42.673290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:42.709543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:42.744059 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1183/2363] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:31:42.782741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:42.784443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:42.859387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5280e-57c3-4751-ace7-75904d1f68dd service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:42.865313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974a398-d155-42c1-8ef0-48c1d6f2ff8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:42.865946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a398-d155-42c1-8ef0-48c1d6f2ff8c service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:42.866231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a398-d155-42c1-8ef0-48c1d6f2ff8c service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:42.866532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974a398-d155-42c1-8ef0-48c1d6f2ff8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:42.873512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:42.879476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974a398-d155-42c1-8ef0-48c1d6f2ff8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:42.879476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974a398-d155-42c1-8ef0-48c1d6f2ff8c service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:42.887402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1181/2364] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:44.272488 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:44.273907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:44.350612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12fb13-08b0-4352-a189-92021e30dda2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:44.356739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce4c1a-6508-42e7-be15-b9a7f97f67db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:44.357437 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce4c1a-6508-42e7-be15-b9a7f97f67db service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:44.357724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce4c1a-6508-42e7-be15-b9a7f97f67db service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:44.358065 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce4c1a-6508-42e7-be15-b9a7f97f67db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:44.360682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-43ce4c1a-6508-42e7-be15-b9a7f97f67db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:44.374151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce4c1a-6508-42e7-be15-b9a7f97f67db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:44.375992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce4c1a-6508-42e7-be15-b9a7f97f67db service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:44.387942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1184/2365] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:44.821567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:44.822056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:44.822153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:44.845107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] MFA Rules not processed for user `a0a8d082773543c5942d7485b92fa601`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:44.846317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:44.903468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1182/2366] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:51.376445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf5d0-8712-452b-9842-eb2a1e3c408d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:51.376445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf5d0-8712-452b-9842-eb2a1e3c408d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:51.376445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf5d0-8712-452b-9842-eb2a1e3c408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:51.412936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f03bf5d0-8712-452b-9842-eb2a1e3c408d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:51.414396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f03bf5d0-8712-452b-9842-eb2a1e3c408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:51.432775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1185/2367] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:51.456384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:51.457866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:51.487082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed822-9bb8-4ca0-8333-08e11169de06 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:51.504399 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:51.505624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:51.506185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:51.506907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:51.518107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:51.520705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:51.538418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1183/2368] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:55.359680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb98c9-afde-46fa-93d5-b5a215aea4ea None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:55.360186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb98c9-afde-46fa-93d5-b5a215aea4ea None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:55.360319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb98c9-afde-46fa-93d5-b5a215aea4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:55.379914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b8fb98c9-afde-46fa-93d5-b5a215aea4ea None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:55.381074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b8fb98c9-afde-46fa-93d5-b5a215aea4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:55.389964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1186/2369] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:55.422723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:55.434678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53946266-f846-4aee-8793-d793143e2b73 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:55.441217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb11c01-fe77-4650-8162-8d758f6eb072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:55.441823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11c01-fe77-4650-8162-8d758f6eb072 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:55.442106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11c01-fe77-4650-8162-8d758f6eb072 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:55.442383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb11c01-fe77-4650-8162-8d758f6eb072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:55.450899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb11c01-fe77-4650-8162-8d758f6eb072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:55.452555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb11c01-fe77-4650-8162-8d758f6eb072 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:55.462866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1184/2370] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:56.352292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb98c9-afde-46fa-93d5-b5a215aea4ea None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:56.361954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb98c9-afde-46fa-93d5-b5a215aea4ea None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:56.366698 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:56.367354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:56.367659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:56.367937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] PATH_INFO: `/v3/users/2e6a8d4e589642178641051ca5396dc6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:56.369113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6a8d4e589642178641051ca5396dc6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:56.371209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:56.573309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6a8d4e589642178641051ca5396dc6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:56.574774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6a8d4e589642178641051ca5396dc6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:56.587612 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6a8d4e589642178641051ca5396dc6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:56.588445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6a8d4e589642178641051ca5396dc6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:56.674046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6a8d4e589642178641051ca5396dc6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:56.687927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1187/2371] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:31:56 2022] DELETE /identity/v3/users/2e6a8d4e589642178641051ca5396dc6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:56.692450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:56.692920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:56.693014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:56.712547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:56.713761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:56.775033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1185/2372] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:31:56.785028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:56.786408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:56.806445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:56.845800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57aa76e-9c98-4935-8c1e-b9da2300c205 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:56.849639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fec87-7da3-4fc5-a620-2fc890b982f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:56.850244 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fec87-7da3-4fc5-a620-2fc890b982f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:56.850526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fec87-7da3-4fc5-a620-2fc890b982f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:56.850801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fec87-7da3-4fc5-a620-2fc890b982f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:56.859910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fec87-7da3-4fc5-a620-2fc890b982f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:56.861386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fec87-7da3-4fc5-a620-2fc890b982f3 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:56.872119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1188/2373] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:31:57.269795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:57.271245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:57.294896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec65e0-f0a0-4d92-9da8-55760f9cc77d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:57.311245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:57.312230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:57.312546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:57.312824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] PATH_INFO: `/v3/projects/00f6d709ca63437691291cd79c65f459` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:57.314108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f6d709ca63437691291cd79c65f459)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:57.317211 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:57.440120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f6d709ca63437691291cd79c65f459', 'request_id': 'req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:57.445592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f6d709ca63437691291cd79c65f459', 'request_id': 'req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:57.452023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f6d709ca63437691291cd79c65f459', 'request_id': 'req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:57.549777 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:57.557151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] The token cache is being invalidate because project 00f6d709ca63437691291cd79c65f459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:31:57.557445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:57.563633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5643cf64-693d-48a1-bdc3-abb8a4f29ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:31:57.563633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1186/2374] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:57 2022] DELETE /identity/v3/projects/00f6d709ca63437691291cd79c65f459 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:57.564788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772f68-9a7c-49e4-8979-2474aa0d3aef None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:57.565231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772f68-9a7c-49e4-8979-2474aa0d3aef None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:57.565352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19772f68-9a7c-49e4-8979-2474aa0d3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:57.587251 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-19772f68-9a7c-49e4-8979-2474aa0d3aef None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:57.588522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-19772f68-9a7c-49e4-8979-2474aa0d3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:57.651656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1189/2375] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:57.660158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80eae9-4121-4f96-84e4-43cb60eca5aa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:57.660472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80eae9-4121-4f96-84e4-43cb60eca5aa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:57.660859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80eae9-4121-4f96-84e4-43cb60eca5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:57.682023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ed80eae9-4121-4f96-84e4-43cb60eca5aa None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:57.683046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ed80eae9-4121-4f96-84e4-43cb60eca5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:57.694872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1187/2376] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:31:57.696603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772f68-9a7c-49e4-8979-2474aa0d3aef None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:57.707534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19772f68-9a7c-49e4-8979-2474aa0d3aef None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:57.712843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:57.713461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:57.716082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:57.716082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:57.716082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:31:57.716082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:57.717438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:57.733285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1190/2377] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:31:57.734634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80eae9-4121-4f96-84e4-43cb60eca5aa None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:57.743823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80eae9-4121-4f96-84e4-43cb60eca5aa None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:57.749778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:57.750767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:57.750767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:57.750970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:57.751548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:57.753512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:57.839091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1188/2378] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:31:57 2022] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:57.841272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:57.853204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d474e-e318-4956-9f9c-faed470b2541 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:57.918859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:57.919619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:57.919926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:57.920195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:57.920856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:57.922775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:58.036299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1191/2379] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:31:57 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:31:58.040588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:58.051605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b09e2-02e2-4359-be63-ccb0932a00b0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:58.056138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:58.056764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:58.057043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:58.057314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:58.057952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:58.060561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:58.071677 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1189/2380] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:58.076471 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:58.086796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d119ad-700c-40d6-88ea-101656385b7e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:58.091514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:58.092139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:58.092452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:58.092727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:58.093395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:58.094997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:58.109176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1192/2381] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:31:58.110359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:58.123257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb958ab1-c9b2-4136-93a2-004c5a66607f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:58.127364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:58.127906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930316a6-722f-458b-bd89-22358323d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:58.128618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930316a6-722f-458b-bd89-22358323d0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:58.128898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930316a6-722f-458b-bd89-22358323d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:58.129170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930316a6-722f-458b-bd89-22358323d0a5 admin admin] PATH_INFO: `/v3/projects/559234b8eb1b49168fcc39505b978a23/users/c1fe523a03814f339d80f25a473a495d/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:58.129375 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:58.145971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930316a6-722f-458b-bd89-22358323d0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559234b8eb1b49168fcc39505b978a23, user_id=c1fe523a03814f339d80f25a473a495d, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:58.148687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930316a6-722f-458b-bd89-22358323d0a5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:58.164050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:58.191141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67116ce5-70a5-4293-ae6e-a927d533b25b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:58.194957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:58.195566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:58.195844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:58.196143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:58.197968 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:58.240152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1190/2382] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:31:58 2022] PUT /identity/v3/projects/559234b8eb1b49168fcc39505b978a23/users/c1fe523a03814f339d80f25a473a495d/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:31:58.252267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec07e6-90df-4cfb-92e2-f5374a539cea None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:58.252562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec07e6-90df-4cfb-92e2-f5374a539cea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:58.252848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec07e6-90df-4cfb-92e2-f5374a539cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:58.263113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:58.264674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:58.274464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1193/2383] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:31:58.283550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-55ec07e6-90df-4cfb-92e2-f5374a539cea None None] MFA Rules not processed for user `c1fe523a03814f339d80f25a473a495d`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:31:58.284880 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55ec07e6-90df-4cfb-92e2-f5374a539cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:58.364028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1191/2384] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:31:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:31:58.375689 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:31:58.377263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:31:58.437882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf777f6-b6a1-472a-b3c7-6efb020b8d69 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:31:58.488684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa8763-1f18-4573-bed3-62c2d0c7077d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:31:58.489288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8763-1f18-4573-bed3-62c2d0c7077d service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:31:58.489572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8763-1f18-4573-bed3-62c2d0c7077d service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:31:58.489843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa8763-1f18-4573-bed3-62c2d0c7077d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:31:58.498636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa8763-1f18-4573-bed3-62c2d0c7077d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:31:58.500056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa8763-1f18-4573-bed3-62c2d0c7077d service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:31:58.509736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1194/2385] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:31:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:32:04.567830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec07e6-90df-4cfb-92e2-f5374a539cea None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:04.634540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec07e6-90df-4cfb-92e2-f5374a539cea None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:04.639745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:04.640409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:04.640694 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:04.640971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] PATH_INFO: `/v3/users/c1fe523a03814f339d80f25a473a495d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:04.642119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fe523a03814f339d80f25a473a495d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:04.644151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:04.734600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:04.735133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:04.735133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:04.743054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:04.756547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:04.758178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:04.767302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1195/2386] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:32:04.791753 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:04.793198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:04.825821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:04.865216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43425efd-a0fd-45c8-9b98-41a060397c1a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:04.870827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144601d-41a8-4215-9d9b-efc2ccec3644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:04.871440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144601d-41a8-4215-9d9b-efc2ccec3644 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:04.871722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144601d-41a8-4215-9d9b-efc2ccec3644 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:04.872551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144601d-41a8-4215-9d9b-efc2ccec3644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:04.877183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fe523a03814f339d80f25a473a495d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:04.877869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fe523a03814f339d80f25a473a495d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:04.880859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144601d-41a8-4215-9d9b-efc2ccec3644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:04.882693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144601d-41a8-4215-9d9b-efc2ccec3644 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:04.892261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fe523a03814f339d80f25a473a495d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:04.894777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1196/2387] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:32:04.910931 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fe523a03814f339d80f25a473a495d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:04.911738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fe523a03814f339d80f25a473a495d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:05.004148 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1192/2388] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:32:04 2022] DELETE /identity/v3/users/c1fe523a03814f339d80f25a473a495d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:32:05.009067 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:05.009410 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:05.009699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:05.029314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:05.030667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:05.095291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1197/2389] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:05.102681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:05.104507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:05.170824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2917-323c-41a0-b205-734e6667556b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:05.174487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615877-9929-4eed-8961-1461a1c638b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:05.175100 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615877-9929-4eed-8961-1461a1c638b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:05.175378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615877-9929-4eed-8961-1461a1c638b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:05.175650 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615877-9929-4eed-8961-1461a1c638b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:05.185998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615877-9929-4eed-8961-1461a1c638b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:05.187542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615877-9929-4eed-8961-1461a1c638b4 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:05.198430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1193/2390] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:32:05.584898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:05.586325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:05.600026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ccedc-80e9-4b0b-bc68-61c5f95f928f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:05.603926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:05.604879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:05.605232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:05.605582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] PATH_INFO: `/v3/projects/559234b8eb1b49168fcc39505b978a23` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:05.606801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] RBAC: Authorizing `identity:delete_project(project_id=559234b8eb1b49168fcc39505b978a23)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:05.610160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:05.738998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559234b8eb1b49168fcc39505b978a23', 'request_id': 'req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:05.745651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559234b8eb1b49168fcc39505b978a23', 'request_id': 'req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:05.827953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559234b8eb1b49168fcc39505b978a23', 'request_id': 'req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:05.840398 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] The token cache is being invalidate because project 559234b8eb1b49168fcc39505b978a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:32:05.840688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:05.841320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:05.842920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1198/2391] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:05 2022] DELETE /identity/v3/projects/559234b8eb1b49168fcc39505b978a23 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:32:11.061375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3ad5-d26e-4a2d-a1d3-6e17826cdf6a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:11.062174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3ad5-d26e-4a2d-a1d3-6e17826cdf6a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:11.062462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec3ad5-d26e-4a2d-a1d3-6e17826cdf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:11.093326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-40ec3ad5-d26e-4a2d-a1d3-6e17826cdf6a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:11.095546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-40ec3ad5-d26e-4a2d-a1d3-6e17826cdf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:11.178977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1194/2392] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:11.209520 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:11.211411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:11.266752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:11.300336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c0fc2-5ae9-4400-a4e7-c462c9ad233f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:11.306333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:11.306941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:11.307223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:11.307495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:11.317334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:11.318919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:11.329343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1199/2393] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:32:20.650999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0171-9812-4774-bf2a-5bfeb43dc370 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:20.651528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0171-9812-4774-bf2a-5bfeb43dc370 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:20.651528 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0171-9812-4774-bf2a-5bfeb43dc370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:20.670687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-804c0171-9812-4774-bf2a-5bfeb43dc370 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:20.671862 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-804c0171-9812-4774-bf2a-5bfeb43dc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:20.713306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:20.727005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1195/2394] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:32:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:20.770200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:20.774374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:20.857569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e640c33-ba7f-4f24-b614-b3967087cf1e service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:20.863590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ce01-9fce-4be9-aa63-e8a5b35ed8b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:20.864201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ce01-9fce-4be9-aa63-e8a5b35ed8b1 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:20.864512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ce01-9fce-4be9-aa63-e8a5b35ed8b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:20.864786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ce01-9fce-4be9-aa63-e8a5b35ed8b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:20.874671 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553ce01-9fce-4be9-aa63-e8a5b35ed8b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:20.876287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553ce01-9fce-4be9-aa63-e8a5b35ed8b1 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:20.887871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1200/2395] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:32:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:32:30.821691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:30.882226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=49 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:34.091913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9042ae-ac81-43a6-8390-53fa4cf55169 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:34.091913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9042ae-ac81-43a6-8390-53fa4cf55169 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:34.091913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9042ae-ac81-43a6-8390-53fa4cf55169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:34.116409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1c9042ae-ac81-43a6-8390-53fa4cf55169 None None] MFA Rules not processed for user `aa5a9394fabf47bb8205d46f2a93f300`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:34.118850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1c9042ae-ac81-43a6-8390-53fa4cf55169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:34.225595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1196/2396] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:32:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:32:37.126163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:37.126699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:37.126699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:37.148026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:37.149455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:37.159902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1201/2397] 10.222.0.86 () {58 vars in 967 bytes} [Thu Aug 18 11:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:37.174022 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9042ae-ac81-43a6-8390-53fa4cf55169 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:37.187000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9042ae-ac81-43a6-8390-53fa4cf55169 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:37.192096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:37.192750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:37.193035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:37.193312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:37.208331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:37.210026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:37.222384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1197/2398] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:32:40.292121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:40.293629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:40.308690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea954633-0ab5-462f-aad1-015147f56967 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:40.314153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:40.314785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:40.315068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:40.315346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] PATH_INFO: `/v3/users/a0a8d082773543c5942d7485b92fa601` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:40.316519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a8d082773543c5942d7485b92fa601)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:40.318449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:40.474085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a8d082773543c5942d7485b92fa601'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:40.474674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a8d082773543c5942d7485b92fa601'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:40.487313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a8d082773543c5942d7485b92fa601'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:40.490905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a8d082773543c5942d7485b92fa601'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:40.535046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ad8a51fc-17e7-4e23-be3b-922f8d5f7940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a8d082773543c5942d7485b92fa601'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:40.548037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1202/2399] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:32:40 2022] DELETE /identity/v3/users/a0a8d082773543c5942d7485b92fa601 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:32:40.783864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:40.800992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084995a-9d41-434c-ac12-311d81a6e2ad service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:40.861289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:40.861863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:40.862152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:40.866328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] PATH_INFO: `/v3/projects/918a94cb6c9d44a0b483b39bd19c54da` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:40.866328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=918a94cb6c9d44a0b483b39bd19c54da)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:40.866328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:40.975849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918a94cb6c9d44a0b483b39bd19c54da', 'request_id': 'req-52525799-2fb1-4565-8299-ed42dedd0a1a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:40.985388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918a94cb6c9d44a0b483b39bd19c54da', 'request_id': 'req-52525799-2fb1-4565-8299-ed42dedd0a1a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:40.992253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918a94cb6c9d44a0b483b39bd19c54da', 'request_id': 'req-52525799-2fb1-4565-8299-ed42dedd0a1a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:41.061507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] The token cache is being invalidate because project 918a94cb6c9d44a0b483b39bd19c54da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:32:41.062094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:41.062728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52525799-2fb1-4565-8299-ed42dedd0a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:41.064364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1198/2400] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:40 2022] DELETE /identity/v3/projects/918a94cb6c9d44a0b483b39bd19c54da => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:32:41.069461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7a483-e38a-4634-9d5d-cb1a1ff56348 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.069755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7a483-e38a-4634-9d5d-cb1a1ff56348 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.070026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7a483-e38a-4634-9d5d-cb1a1ff56348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.089711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-71d7a483-e38a-4634-9d5d-cb1a1ff56348 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:41.090980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-71d7a483-e38a-4634-9d5d-cb1a1ff56348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:41.150719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1203/2401] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:32:41.215481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e04d-d0ca-4a1b-a033-0f7078142749 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.215766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e04d-d0ca-4a1b-a033-0f7078142749 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.216038 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e04d-d0ca-4a1b-a033-0f7078142749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.236518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1611e04d-d0ca-4a1b-a033-0f7078142749 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:41.237699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1611e04d-d0ca-4a1b-a033-0f7078142749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:41.245657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1199/2402] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:41.249981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7a483-e38a-4634-9d5d-cb1a1ff56348 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:41.259722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7a483-e38a-4634-9d5d-cb1a1ff56348 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:41.264843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:41.265433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.265922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.266281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.266935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:32:41.267241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:41.268871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:41.280947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1204/2403] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:32:41.285194 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e04d-d0ca-4a1b-a033-0f7078142749 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:41.294476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e04d-d0ca-4a1b-a033-0f7078142749 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:41.299658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:41.300293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.300605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.300879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.301547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:41.303519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:41.318384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:41.376702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1200/2404] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:32:41 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:32:41.386501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:41.397223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd561050-05ee-41a9-8818-62e1a4cefa10 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:41.445723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:41.455483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:41.456089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.456406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.456708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.457329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:41.459294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:41.523748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1205/2405] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:32:41 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:32:41.528280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:41.547058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864ef00-5f32-438a-8036-8e9e3bc92124 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:41.551658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:41.552279 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.552560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.552834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.553499 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:41.555090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:41.565697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1201/2406] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:32:41.569705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:41.580092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0467b-0f80-48e5-9069-5417763b8831 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:41.584714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65fa53-ef6d-4c6c-b4ab-af8e62eba630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:41.585312 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65fa53-ef6d-4c6c-b4ab-af8e62eba630 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.585595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65fa53-ef6d-4c6c-b4ab-af8e62eba630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.585873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65fa53-ef6d-4c6c-b4ab-af8e62eba630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.586516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65fa53-ef6d-4c6c-b4ab-af8e62eba630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:41.588098 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65fa53-ef6d-4c6c-b4ab-af8e62eba630 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:41.598497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1206/2407] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:32:41.602509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:41.612644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4320-19d1-4c7a-b096-c8e77d1f9198 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:41.617457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:41.618109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.618393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.618671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] PATH_INFO: `/v3/projects/d390de247f6f4c668ea9df53a68fc66d/users/c4f54fbffcb3476493c23d428d0935c6/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.634047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d390de247f6f4c668ea9df53a68fc66d, user_id=c4f54fbffcb3476493c23d428d0935c6, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:41.636745 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:41.718600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1202/2408] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:32:41 2022] PUT /identity/v3/projects/d390de247f6f4c668ea9df53a68fc66d/users/c4f54fbffcb3476493c23d428d0935c6/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:32:41.728950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e22ec-d94e-41c0-99fc-fa1179287b0b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.729309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e22ec-d94e-41c0-99fc-fa1179287b0b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.729640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e22ec-d94e-41c0-99fc-fa1179287b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.758269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-730e22ec-d94e-41c0-99fc-fa1179287b0b None None] MFA Rules not processed for user `c4f54fbffcb3476493c23d428d0935c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:41.759469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-730e22ec-d94e-41c0-99fc-fa1179287b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:41.823151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1207/2409] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:41.833553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:41.835231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:41.899259 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788ffb6-3c43-4ed8-a727-58b567c022e6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:41.903002 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:41.903652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:41.903934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:41.904298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:41.913004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:41.914428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:41.923965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1203/2410] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:32:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:32:51.820383 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:51.919406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:52.686893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758a7b-c943-40cc-a81b-b1a9000eca25 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:52.687293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758a7b-c943-40cc-a81b-b1a9000eca25 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:52.687615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758a7b-c943-40cc-a81b-b1a9000eca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:52.708113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c2758a7b-c943-40cc-a81b-b1a9000eca25 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:52.709462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2758a7b-c943-40cc-a81b-b1a9000eca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:52.767595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1208/2411] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:32:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:52.780024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:52.781689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:52.851512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375c40b-4149-4cb4-a37e-9a73ffd00f1d service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:52.856553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97497b-0d06-4ce1-9c22-78d16680a868 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:52.857690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97497b-0d06-4ce1-9c22-78d16680a868 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:52.857974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97497b-0d06-4ce1-9c22-78d16680a868 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:52.858251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97497b-0d06-4ce1-9c22-78d16680a868 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:52.866456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97497b-0d06-4ce1-9c22-78d16680a868 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:52.868070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97497b-0d06-4ce1-9c22-78d16680a868 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:52.877372 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1204/2412] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:32:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:32:55.527158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758a7b-c943-40cc-a81b-b1a9000eca25 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:55.613407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758a7b-c943-40cc-a81b-b1a9000eca25 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:55.618328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:55.618967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:55.619247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:55.619521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] PATH_INFO: `/v3/users/c4f54fbffcb3476493c23d428d0935c6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:55.620693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f54fbffcb3476493c23d428d0935c6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:55.623335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:55.807992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f54fbffcb3476493c23d428d0935c6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:55.808893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f54fbffcb3476493c23d428d0935c6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:55.824436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f54fbffcb3476493c23d428d0935c6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:55.825297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f54fbffcb3476493c23d428d0935c6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:55.883527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f54fbffcb3476493c23d428d0935c6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:55.898319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1209/2413] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:32:55 2022] DELETE /identity/v3/users/c4f54fbffcb3476493c23d428d0935c6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:32:55.903675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:55.904288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:55.904405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:55.924001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:55.925233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:55.992697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1205/2414] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:56.003637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:56.005212 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:56.038741 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:56.069821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3592b6-2969-4d0f-bd19-d3b85f78364e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:56.074467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d13ad-4fca-40ae-8f87-93d7586289da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:56.075194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d13ad-4fca-40ae-8f87-93d7586289da service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:56.075506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d13ad-4fca-40ae-8f87-93d7586289da service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:56.076296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d13ad-4fca-40ae-8f87-93d7586289da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:56.085828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d13ad-4fca-40ae-8f87-93d7586289da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:56.087296 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d13ad-4fca-40ae-8f87-93d7586289da service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:56.098694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1210/2415] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:32:56.516680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:56.518817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:56.540620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee161-75de-49a2-98c5-40bcf472d183 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:56.555839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:56.556834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:56.557123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:56.557402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] PATH_INFO: `/v3/projects/d390de247f6f4c668ea9df53a68fc66d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:56.558928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d390de247f6f4c668ea9df53a68fc66d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:56.561933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:56.710268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd390de247f6f4c668ea9df53a68fc66d', 'request_id': 'req-c9308777-ef39-4b9d-a991-5920c8c0e4c1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:56.716163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd390de247f6f4c668ea9df53a68fc66d', 'request_id': 'req-c9308777-ef39-4b9d-a991-5920c8c0e4c1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:56.723222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd390de247f6f4c668ea9df53a68fc66d', 'request_id': 'req-c9308777-ef39-4b9d-a991-5920c8c0e4c1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:56.803882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] The token cache is being invalidate because project d390de247f6f4c668ea9df53a68fc66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:32:56.804437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:56.807196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:32:56.807196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1206/2416] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:56 2022] DELETE /identity/v3/projects/d390de247f6f4c668ea9df53a68fc66d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:32:57.714523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9222a0-4043-4f49-849f-d4ef8c225188 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:57.715134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9222a0-4043-4f49-849f-d4ef8c225188 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:57.715276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9222a0-4043-4f49-849f-d4ef8c225188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:57.736083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cb9222a0-4043-4f49-849f-d4ef8c225188 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:32:57.738847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cb9222a0-4043-4f49-849f-d4ef8c225188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:57.822922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1211/2417] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:32:57.845218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:32:57.846755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:32:57.865159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:57.939483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9308777-ef39-4b9d-a991-5920c8c0e4c1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:32:57.945761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:32:57.946384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:32:57.946663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:32:57.946935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:32:57.959342 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:32:57.961049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:32:57.973503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1207/2418] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:02.590321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d903f-7a0a-40b7-a1ee-75433727f3f6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:02.596415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d903f-7a0a-40b7-a1ee-75433727f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:02.596415 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d903f-7a0a-40b7-a1ee-75433727f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:02.611513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ff9d903f-7a0a-40b7-a1ee-75433727f3f6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:02.612752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ff9d903f-7a0a-40b7-a1ee-75433727f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:02.620788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1212/2419] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:02.656600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:02.658073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:02.675019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85d158-59fa-4193-9735-38ec5ecb9e6f service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:02.681522 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:02.682183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:02.682464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:02.682737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:02.691492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:02.693414 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:02.703594 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1208/2420] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:06.462084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba61b5-83ba-4642-a2fc-a5adda61f1f0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:06.462737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba61b5-83ba-4642-a2fc-a5adda61f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:06.462971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba61b5-83ba-4642-a2fc-a5adda61f1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:06.485517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b1ba61b5-83ba-4642-a2fc-a5adda61f1f0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:06.487346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b1ba61b5-83ba-4642-a2fc-a5adda61f1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:06.498277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1213/2421] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:06.521408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:06.535561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4008a-93d7-4610-ab34-ed2032f4d50e service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:06.541750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:06.546163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:06.546163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:06.546163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:06.564506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:06.566470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:06.581633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1209/2422] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:10.707365 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68abe43-adac-4f1e-9099-c07a9b10a7dd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:10.707943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68abe43-adac-4f1e-9099-c07a9b10a7dd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:10.707943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68abe43-adac-4f1e-9099-c07a9b10a7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:10.728029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e68abe43-adac-4f1e-9099-c07a9b10a7dd None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:10.729182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e68abe43-adac-4f1e-9099-c07a9b10a7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:10.738208 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1214/2423] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:10.765580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:10.777055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004160-7ca5-4a1a-9ab4-d67e1a731fc7 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:10.783614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267b6a8-00d3-41e1-8cd5-0ec1a1c0d77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:10.784246 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b6a8-00d3-41e1-8cd5-0ec1a1c0d77b service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:10.784530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b6a8-00d3-41e1-8cd5-0ec1a1c0d77b service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:10.784803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b6a8-00d3-41e1-8cd5-0ec1a1c0d77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:10.793597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267b6a8-00d3-41e1-8cd5-0ec1a1c0d77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:10.796311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267b6a8-00d3-41e1-8cd5-0ec1a1c0d77b service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:10.806506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1210/2424] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:16.679548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc0f4-4e26-4515-8803-589f44e6b1df None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:16.680095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc0f4-4e26-4515-8803-589f44e6b1df None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:16.680095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc0f4-4e26-4515-8803-589f44e6b1df None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:16.681547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1215/2425] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:33:16.688481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55a055-645f-46c7-9188-c2001f498891 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:16.688966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55a055-645f-46c7-9188-c2001f498891 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:16.689078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55a055-645f-46c7-9188-c2001f498891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:16.709722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8c55a055-645f-46c7-9188-c2001f498891 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:16.710929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8c55a055-645f-46c7-9188-c2001f498891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:16.721401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1211/2426] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:16.734515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc0f4-4e26-4515-8803-589f44e6b1df None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:16.736196 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0adc0f4-4e26-4515-8803-589f44e6b1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:16.798277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc0f4-4e26-4515-8803-589f44e6b1df None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:16.801756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99c68c-92d4-4755-bf89-93d8c0cb35f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514818f5b23c4234b259e5b47e698a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:16.802360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c68c-92d4-4755-bf89-93d8c0cb35f5 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:16.802653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c68c-92d4-4755-bf89-93d8c0cb35f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:16.802908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99c68c-92d4-4755-bf89-93d8c0cb35f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:16.813228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99c68c-92d4-4755-bf89-93d8c0cb35f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:16.814684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99c68c-92d4-4755-bf89-93d8c0cb35f5 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:16.826297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1216/2427] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:17.058678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d944f41-f4ab-4d85-88ca-b731b84dfb9b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.059011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d944f41-f4ab-4d85-88ca-b731b84dfb9b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.059525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d944f41-f4ab-4d85-88ca-b731b84dfb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.079552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d243-d3bf-4062-96da-e87c7ab5a0a9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.079773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5d944f41-f4ab-4d85-88ca-b731b84dfb9b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:17.079885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d243-d3bf-4062-96da-e87c7ab5a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.080127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d243-d3bf-4062-96da-e87c7ab5a0a9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.080975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5d944f41-f4ab-4d85-88ca-b731b84dfb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:17.081645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1217/2428] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 11:33:17.086107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9757-616b-4202-b54b-011fbd7994c2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.086392 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9757-616b-4202-b54b-011fbd7994c2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.086668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9757-616b-4202-b54b-011fbd7994c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.089897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1212/2429] 10.222.0.87 () {58 vars in 1016 bytes} [Thu Aug 18 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:17.107404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-32cc9757-616b-4202-b54b-011fbd7994c2 None None] MFA Rules not processed for user `bfd4d0f2f95b4861888c33b0c66c602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:17.108553 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-32cc9757-616b-4202-b54b-011fbd7994c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:17.115105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d944f41-f4ab-4d85-88ca-b731b84dfb9b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:17.128954 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d944f41-f4ab-4d85-88ca-b731b84dfb9b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:17.134922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:17.135547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.135831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.136140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.146339 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:17.147162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:17.156959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1213/2430] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:33:17.161026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:17.167660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1218/2431] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:17.179645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:17.181164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:17.195496 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9332c1-e01b-462c-88e1-3431cf6080e5 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:17.199291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb1426-b4b3-4d52-86a2-557ecdcfbeed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:17.200548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1426-b4b3-4d52-86a2-557ecdcfbeed service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.200831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1426-b4b3-4d52-86a2-557ecdcfbeed service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.201115 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1426-b4b3-4d52-86a2-557ecdcfbeed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.208622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb1426-b4b3-4d52-86a2-557ecdcfbeed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:17.210055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb1426-b4b3-4d52-86a2-557ecdcfbeed service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:17.219109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1214/2432] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:17.306359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698b98b-09cf-49fc-9392-842229fe428a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.306675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698b98b-09cf-49fc-9392-842229fe428a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.308927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698b98b-09cf-49fc-9392-842229fe428a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.308927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1219/2433] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:33:17.315053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf93f77-ddd0-4ca3-9416-fb65d378e874 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.315346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf93f77-ddd0-4ca3-9416-fb65d378e874 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.315627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf93f77-ddd0-4ca3-9416-fb65d378e874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.336666 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0cf93f77-ddd0-4ca3-9416-fb65d378e874 None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:17.337912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0cf93f77-ddd0-4ca3-9416-fb65d378e874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:17.348011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1215/2434] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:17.359730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698b98b-09cf-49fc-9392-842229fe428a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:17.370713 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698b98b-09cf-49fc-9392-842229fe428a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:17.374795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:17.375392 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:17.375681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:17.375958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:17.386317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:17.387773 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:17.398788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1220/2435] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:33:24.210720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9129-2d5a-4eb1-9169-64e3c2777ca1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:24.211152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9129-2d5a-4eb1-9169-64e3c2777ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:24.211489 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9129-2d5a-4eb1-9169-64e3c2777ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:24.235563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c20d9129-2d5a-4eb1-9169-64e3c2777ca1 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:24.236816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c20d9129-2d5a-4eb1-9169-64e3c2777ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:24.296456 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1216/2436] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:33:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:24.320104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:24.321567 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:24.392269 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19374e-f17c-4f29-9270-4a74c4bcee67 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:24.397207 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:24.397816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:24.398106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:24.398386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:24.406422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:24.407995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:24.415930 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1221/2437] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:34.288703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:34.421263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=38 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:37.230912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9129-2d5a-4eb1-9169-64e3c2777ca1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:37.241379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9129-2d5a-4eb1-9169-64e3c2777ca1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:37.245436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:37.246099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:37.246401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:37.246678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:37.248760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:37.265796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:37.267412 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:37.282020 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1217/2438] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:40.826334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:40.835752 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdda79-a69c-418a-bede-c3238c577d22 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:40.839508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58023da1-3cd9-4d2d-8fee-f9674c2e5259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:40.840136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023da1-3cd9-4d2d-8fee-f9674c2e5259 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:40.840454 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023da1-3cd9-4d2d-8fee-f9674c2e5259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:40.840733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023da1-3cd9-4d2d-8fee-f9674c2e5259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:40.843262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-58023da1-3cd9-4d2d-8fee-f9674c2e5259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:40.857272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58023da1-3cd9-4d2d-8fee-f9674c2e5259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:40.858679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58023da1-3cd9-4d2d-8fee-f9674c2e5259 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:40.869416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1222/2439] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:47.274531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:50.843927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:50.854969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95528b2-050f-42d7-8d1a-43cf56d14b04 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:50.861644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:50.862254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:50.862538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:50.862816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:50.864594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:50.865031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:50.926773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:50.928450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:50.938474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1218/2440] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:33:53.464305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1036ba-6ee1-4193-acbb-3bf80de84c7f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:53.464767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1036ba-6ee1-4193-acbb-3bf80de84c7f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:53.464860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1036ba-6ee1-4193-acbb-3bf80de84c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:53.484774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cf1036ba-6ee1-4193-acbb-3bf80de84c7f None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:33:53.486576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf1036ba-6ee1-4193-acbb-3bf80de84c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:53.494263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1223/2441] 10.222.0.86 () {58 vars in 967 bytes} [Thu Aug 18 11:33:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:33:53.509136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:53.521254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800e3e1-4c54-4e56-aed0-c2b048c9a8ab service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:53.526252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:53.526852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:53.527264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:53.527546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:53.537537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:53.539130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:53.550553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1219/2442] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:56.428817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1036ba-6ee1-4193-acbb-3bf80de84c7f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:33:56.442519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1036ba-6ee1-4193-acbb-3bf80de84c7f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:33:56.448082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:33:56.448729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:33:56.449010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:33:56.449291 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:33:56.451124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:33:56.513095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:33:56.514719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:33:56.523964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1224/2443] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:33:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:34:03.547915 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=34 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:06.519722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=31 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:07.881573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:34:07.894227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb751e8-7265-42b7-a212-f5e8f5960a34 service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:34:07.899278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:34:07.899981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:34:07.900420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:34:07.900715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:34:07.902860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:34:07.914167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:34:07.915964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:34:07.927300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1220/2444] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:34:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:34:10.128809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:34:10.130322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:34:10.145211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee78bf-699f-4e93-8d5b-18f4aadc4541 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:34:10.150734 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:34:10.151311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:34:10.151600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:34:10.152014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] PATH_INFO: `/v3/users/aa5a9394fabf47bb8205d46f2a93f300` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:34:10.153200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5a9394fabf47bb8205d46f2a93f300)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:34:10.164472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:34:10.397824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5a9394fabf47bb8205d46f2a93f300'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:10.398470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5a9394fabf47bb8205d46f2a93f300'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:10.410406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5a9394fabf47bb8205d46f2a93f300'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:10.411037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5a9394fabf47bb8205d46f2a93f300'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:10.487587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07976bde-f392-43be-95fe-26b8de876a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5a9394fabf47bb8205d46f2a93f300'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:10.500132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1225/2445] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:34:10 2022] DELETE /identity/v3/users/aa5a9394fabf47bb8205d46f2a93f300 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:34:10.739718 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:34:10.751982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14589ce2-0370-48af-9e3f-3a800b3c442d service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:34:10.820913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:34:10.822370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:34:10.822883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:34:10.823382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] PATH_INFO: `/v3/projects/134dd652390444e1ab4bb372d2773ef9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:34:10.825427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=134dd652390444e1ab4bb372d2773ef9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:34:10.829049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:34:10.947351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134dd652390444e1ab4bb372d2773ef9', 'request_id': 'req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:10.954134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134dd652390444e1ab4bb372d2773ef9', 'request_id': 'req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:10.960486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134dd652390444e1ab4bb372d2773ef9', 'request_id': 'req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:11.035289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] The token cache is being invalidate because project 134dd652390444e1ab4bb372d2773ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:34:11.035583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:11.036629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:34:11.038085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1221/2446] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:10 2022] DELETE /identity/v3/projects/134dd652390444e1ab4bb372d2773ef9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:34:11.130816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dd6a-a003-4772-acac-8e510243c025 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:34:11.131407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dd6a-a003-4772-acac-8e510243c025 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:34:11.131407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dd6a-a003-4772-acac-8e510243c025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:34:11.156395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9294dd6a-a003-4772-acac-8e510243c025 None None] MFA Rules not processed for user `79e1333fbbee4656ad73e5b1c3203bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:34:11.156395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9294dd6a-a003-4772-acac-8e510243c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:34:11.238775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1226/2447] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:34:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:34:17.531995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:34:17.533640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:34:17.613462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b9ae-7c64-4751-8229-5a2ea92dc6f2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:34:17.618950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:34:17.619569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:34:17.619846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:34:17.620117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:34:17.621997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:34:17.636320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:34:17.637824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:34:17.649712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1222/2448] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:34:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:34:21.231236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:27.645906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:59.944472 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294dd6a-a003-4772-acac-8e510243c025 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:34:59.957045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294dd6a-a003-4772-acac-8e510243c025 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:34:59.962645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:34:59.963234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:34:59.963513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:34:59.963800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:34:59.965495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:00.024763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:00.026364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:00.035342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1227/2449] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:34:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:06.800101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:06.812738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177cc85-2cc5-4f99-b36b-c64c04791683 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:06.818433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:06.819036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:06.819315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:06.819589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:06.821934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:06.834443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:06.836535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:06.847416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1223/2450] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:07.537000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:07.542898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:07.548838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:07.553763 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:07.567975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a6469-e6c8-4299-8b65-1f2273f8b309 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:07.575543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d83add-76c8-4dae-832e-a738b0e327f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:07.576857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d83add-76c8-4dae-832e-a738b0e327f4 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:07.577288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d83add-76c8-4dae-832e-a738b0e327f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:07.577576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d83add-76c8-4dae-832e-a738b0e327f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:07.579447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64d83add-76c8-4dae-832e-a738b0e327f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:07.593873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d83add-76c8-4dae-832e-a738b0e327f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:07.595809 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d83add-76c8-4dae-832e-a738b0e327f4 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:07.608951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1224/2451] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:07.613058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2cbfd-d22a-4a19-8721-5e12c30594e0 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:07.620581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830f8ad-e93d-4092-ac8b-5b07789990d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:07.621211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f8ad-e93d-4092-ac8b-5b07789990d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:07.621495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f8ad-e93d-4092-ac8b-5b07789990d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:07.621771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830f8ad-e93d-4092-ac8b-5b07789990d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:07.623540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9830f8ad-e93d-4092-ac8b-5b07789990d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:07.636851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830f8ad-e93d-4092-ac8b-5b07789990d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:07.638429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830f8ad-e93d-4092-ac8b-5b07789990d0 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:07.649394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1228/2452] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:08.039447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e41c-fa36-4e3f-be8e-bc6a6d4c8c15 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:08.040336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e41c-fa36-4e3f-be8e-bc6a6d4c8c15 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:08.040773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e41c-fa36-4e3f-be8e-bc6a6d4c8c15 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:08.042277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1225/2453] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:35:08.049361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3998e-0809-4920-b59a-083b69988bac None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:08.049777 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3998e-0809-4920-b59a-083b69988bac None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:08.050363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3998e-0809-4920-b59a-083b69988bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:08.074787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1ec3998e-0809-4920-b59a-083b69988bac None None] MFA Rules not processed for user `bfd4d0f2f95b4861888c33b0c66c602b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:08.076649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1ec3998e-0809-4920-b59a-083b69988bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:08.091919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1229/2454] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:35:08.099669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e41c-fa36-4e3f-be8e-bc6a6d4c8c15 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:08.108286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e116e41c-fa36-4e3f-be8e-bc6a6d4c8c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:08.133858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e41c-fa36-4e3f-be8e-bc6a6d4c8c15 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:08.138230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e67cc-0690-41f3-997b-dcbd03f221ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:08.142300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e67cc-0690-41f3-997b-dcbd03f221ea service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:08.142592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e67cc-0690-41f3-997b-dcbd03f221ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:08.143217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e67cc-0690-41f3-997b-dcbd03f221ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:08.154040 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e67cc-0690-41f3-997b-dcbd03f221ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:08.155822 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e67cc-0690-41f3-997b-dcbd03f221ea service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:08.165151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1226/2455] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:09.285995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15217-c177-4282-8a69-b5cc99478bc5 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:09.286587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15217-c177-4282-8a69-b5cc99478bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:09.286587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15217-c177-4282-8a69-b5cc99478bc5 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:09.287914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1230/2456] 10.222.0.86 () {54 vars in 921 bytes} [Thu Aug 18 11:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 11:35:09.295712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:09.296201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:09.296498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:09.328430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] MFA Rules not processed for user `748eb93057e245c1b8183dbe0340fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:09.330579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:09.340248 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1227/2457] 10.222.0.86 () {58 vars in 1018 bytes} [Thu Aug 18 11:35:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:35:09.351549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a15217-c177-4282-8a69-b5cc99478bc5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:09.362288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a15217-c177-4282-8a69-b5cc99478bc5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:09.366363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652e46-ada9-4b5d-922c-b0e63e197d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:09.367667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652e46-ada9-4b5d-922c-b0e63e197d70 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:09.368013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652e46-ada9-4b5d-922c-b0e63e197d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:09.368393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652e46-ada9-4b5d-922c-b0e63e197d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:09.384885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652e46-ada9-4b5d-922c-b0e63e197d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:09.386434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae652e46-ada9-4b5d-922c-b0e63e197d70 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:09.398427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1231/2458] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:09.465244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:09.466657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:09.588479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106391e5-a87d-4b10-85b7-b47d69bea36f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:09.594131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3439f24-2e4e-4e77-8b83-ce22186220f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:09.594917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439f24-2e4e-4e77-8b83-ce22186220f1 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:09.595294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439f24-2e4e-4e77-8b83-ce22186220f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:09.595664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439f24-2e4e-4e77-8b83-ce22186220f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:09.597566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e3439f24-2e4e-4e77-8b83-ce22186220f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:09.614007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3439f24-2e4e-4e77-8b83-ce22186220f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:09.616360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3439f24-2e4e-4e77-8b83-ce22186220f1 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:09.629138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1228/2459] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:12.283082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a229b-32b8-403c-a69f-bc173c899168 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:12.283617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a229b-32b8-403c-a69f-bc173c899168 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:12.283730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a229b-32b8-403c-a69f-bc173c899168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:12.303273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d77a229b-32b8-403c-a69f-bc173c899168 None None] MFA Rules not processed for user `d1b917bdbd434b538893c060ad44ebd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:12.304515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d77a229b-32b8-403c-a69f-bc173c899168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:12.311544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1232/2460] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:35:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:35:19.624858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=53 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:22.298591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=66 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:29.652764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6344-9f9d-4105-a726-89db64ed2fe0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:29.653338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6344-9f9d-4105-a726-89db64ed2fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:29.653338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff6344-9f9d-4105-a726-89db64ed2fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:29.672601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-56ff6344-9f9d-4105-a726-89db64ed2fe0 None None] MFA Rules not processed for user `2e6a7791b6464326a588553b2e6cf715`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:29.673792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-56ff6344-9f9d-4105-a726-89db64ed2fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:29.730269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1229/2461] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:35:30.121839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a229b-32b8-403c-a69f-bc173c899168 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:30.131727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a229b-32b8-403c-a69f-bc173c899168 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:30.135938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:30.136893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:30.137171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:30.137444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:30.139161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:30.149201 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:30.150659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:30.159826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1233/2462] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:39.723134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=25 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:40.156286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:47.751458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6344-9f9d-4105-a726-89db64ed2fe0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:47.763204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff6344-9f9d-4105-a726-89db64ed2fe0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:47.766947 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:47.767555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:47.767840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:47.768109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:47.770109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:47.837316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:47.839104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:47.850232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1230/2463] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:51.419048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:51.421373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:51.437585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0086-3053-4afe-bf84-7e6158dfc59f service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:51.442971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:51.444124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:51.444595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:51.444716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:51.446550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:51.459338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:51.460964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:51.471359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1234/2464] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:51.554555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:51.556058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:51.569527 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e919c0-c5a1-4f29-9f2e-63291c226d2c service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:51.574197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:51.574831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:51.575131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:51.575390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] PATH_INFO: `/v3/users/79e1333fbbee4656ad73e5b1c3203bd7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:51.576719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e1333fbbee4656ad73e5b1c3203bd7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:51.578644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:51.761684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e1333fbbee4656ad73e5b1c3203bd7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:51.762250 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e1333fbbee4656ad73e5b1c3203bd7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:51.775346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e1333fbbee4656ad73e5b1c3203bd7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:51.782689 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e1333fbbee4656ad73e5b1c3203bd7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:51.783329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6f16ed0f-3660-4bc0-89f9-7c2c46aa067f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e1333fbbee4656ad73e5b1c3203bd7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:51.843821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1231/2465] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:35:51 2022] DELETE /identity/v3/users/79e1333fbbee4656ad73e5b1c3203bd7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:35:52.108947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:52.120790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e60e2a-7857-43b9-9c79-fa960f150c79 service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:52.182493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:52.183237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.183514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.183789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] PATH_INFO: `/v3/projects/53ff16662af74fbeb2d72efe21c7a9d2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.184944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ff16662af74fbeb2d72efe21c7a9d2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:52.187062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:52.341255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ff16662af74fbeb2d72efe21c7a9d2', 'request_id': 'req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:52.347240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ff16662af74fbeb2d72efe21c7a9d2', 'request_id': 'req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:52.426729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ff16662af74fbeb2d72efe21c7a9d2', 'request_id': 'req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:52.438401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] The token cache is being invalidate because project 53ff16662af74fbeb2d72efe21c7a9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:35:52.438686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:52.439319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e2036f96-2b74-4b7e-acdd-f3ed52fa6303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:35:52.440827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1235/2466] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:52 2022] DELETE /identity/v3/projects/53ff16662af74fbeb2d72efe21c7a9d2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:35:52.445786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b7a15-aa48-4186-9e84-02f7ba2e517e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.446077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b7a15-aa48-4186-9e84-02f7ba2e517e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.446356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b7a15-aa48-4186-9e84-02f7ba2e517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.465779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d60b7a15-aa48-4186-9e84-02f7ba2e517e None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:52.467746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d60b7a15-aa48-4186-9e84-02f7ba2e517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:52.525804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1232/2467] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:35:52.534347 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52379-d2b2-434c-9240-ea8806784d68 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.534636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52379-d2b2-434c-9240-ea8806784d68 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.535052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52379-d2b2-434c-9240-ea8806784d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.554984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-62d52379-d2b2-434c-9240-ea8806784d68 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:52.556168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62d52379-d2b2-434c-9240-ea8806784d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:52.564463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1236/2468] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:35:52.568653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b7a15-aa48-4186-9e84-02f7ba2e517e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:52.579057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b7a15-aa48-4186-9e84-02f7ba2e517e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:52.583609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:52.584239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.584518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.584812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.585447 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:35:52.585755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:52.587360 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:52.588985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:52.600028 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1233/2469] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:35:52.612655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d52379-d2b2-434c-9240-ea8806784d68 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:52.622051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d52379-d2b2-434c-9240-ea8806784d68 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:52.627272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:52.627866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.628150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.628463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.629104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:52.631043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:52.720564 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1237/2470] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:35:52 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:35:52.724706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:52.735065 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fd7fc-cdd3-4285-afbc-b8b8f2ba2422 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:52.791561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:52.792161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.792470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.792756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.793363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:52.795804 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:52.891209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1234/2471] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:35:52 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:35:52.895816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:52.908241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1687e-f114-477c-97f2-ada26ddf2c96 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:52.913171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:52.913850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.914138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.914542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.915368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:52.917151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:52.929366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1238/2472] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:35:52.933502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:52.944293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b77bf4-ec43-4968-9f25-a553471ba8d1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:52.949019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16028888-0f04-4a22-afcc-f40d78793589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:52.949715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16028888-0f04-4a22-afcc-f40d78793589 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:52.950067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16028888-0f04-4a22-afcc-f40d78793589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:52.950415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16028888-0f04-4a22-afcc-f40d78793589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:52.951697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16028888-0f04-4a22-afcc-f40d78793589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:52.953401 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16028888-0f04-4a22-afcc-f40d78793589 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:52.972174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1235/2473] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:35:52.976542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:52.986794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0a75-9880-46ed-917c-f4b8875a2523 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:52.991428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:53.000307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.000307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.000307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] PATH_INFO: `/v3/projects/71e1ec324d4b4452b7b442b66dae46e9/users/a2694371872243d499a156f6387377f6/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.008464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e1ec324d4b4452b7b442b66dae46e9, user_id=a2694371872243d499a156f6387377f6, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:53.011213 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:53.089717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1239/2474] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:35:52 2022] PUT /identity/v3/projects/71e1ec324d4b4452b7b442b66dae46e9/users/a2694371872243d499a156f6387377f6/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:35:53.106609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392d13-7dc0-4d40-953b-00e560ca1b75 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.107025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392d13-7dc0-4d40-953b-00e560ca1b75 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.107808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392d13-7dc0-4d40-953b-00e560ca1b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.137430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2e392d13-7dc0-4d40-953b-00e560ca1b75 None None] MFA Rules not processed for user `a2694371872243d499a156f6387377f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:53.139350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2e392d13-7dc0-4d40-953b-00e560ca1b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:53.203186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1236/2475] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:35:53.207757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:53.221774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:53.270044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ff0e-97f9-4303-a77e-3a020bb7b0d6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:53.274607 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:53.275211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.275494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.275771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.276512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:53.278422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:53.445646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1240/2476] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:35:53 2022] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:35:53.449850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392d13-7dc0-4d40-953b-00e560ca1b75 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:53.461171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392d13-7dc0-4d40-953b-00e560ca1b75 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:53.517825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:53.518427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.518705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.518983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.519603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:53.521593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:53.530286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:53.644628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1237/2477] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:35:53 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:35:53.648681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:53.660447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780109f2-3b80-4d34-8a7d-999d3d4434be admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:53.665654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:53.666261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.666544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.666820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.667463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:53.669105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:53.680637 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1241/2478] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:35:53.686277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:53.696973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118306-9f49-44e2-b33a-1579a8833cfe admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:53.701596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:53.702240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.702520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.702796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] PATH_INFO: `/v3/projects/ead85e95fb544473bfb87524f4b7c653/users/80eed98c012a4447912e0e8917816ac5/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.718927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead85e95fb544473bfb87524f4b7c653, user_id=80eed98c012a4447912e0e8917816ac5, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:53.721639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:53.833092 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1238/2479] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:35:53 2022] PUT /identity/v3/projects/ead85e95fb544473bfb87524f4b7c653/users/80eed98c012a4447912e0e8917816ac5/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:35:53.837108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:53.847651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf73843-e0a7-4d13-8919-923ba6ecf688 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:53.902056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f041f0f-22db-4754-b348-0e05aef00de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:53.902657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f041f0f-22db-4754-b348-0e05aef00de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.902940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f041f0f-22db-4754-b348-0e05aef00de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.903216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f041f0f-22db-4754-b348-0e05aef00de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.904539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f041f0f-22db-4754-b348-0e05aef00de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:53.906285 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f041f0f-22db-4754-b348-0e05aef00de1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:53.915781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1242/2480] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:35:53.920762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:53.930936 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8198ff1-f0aa-4947-97df-1b1457b37357 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:53.935971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:53.936651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.936952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.937214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] PATH_INFO: `/v3/projects/ead85e95fb544473bfb87524f4b7c653/users/80eed98c012a4447912e0e8917816ac5/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.939158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead85e95fb544473bfb87524f4b7c653, user_id=80eed98c012a4447912e0e8917816ac5, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:53.941855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:53.952461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1239/2481] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:35:53 2022] PUT /identity/v3/projects/ead85e95fb544473bfb87524f4b7c653/users/80eed98c012a4447912e0e8917816ac5/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:35:53.962561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616c70-9de5-4c74-bc45-9b9435b7578c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:53.962848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616c70-9de5-4c74-bc45-9b9435b7578c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:53.963128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616c70-9de5-4c74-bc45-9b9435b7578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:53.993192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f0616c70-9de5-4c74-bc45-9b9435b7578c None None] MFA Rules not processed for user `80eed98c012a4447912e0e8917816ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:35:53.994434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0616c70-9de5-4c74-bc45-9b9435b7578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:54.062326 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1243/2482] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:35:54.073575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:54.075260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:35:54.134493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5076-1002-4c3f-965b-89249c25a03f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:54.138610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:54.139219 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:54.139550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:54.139873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:54.149572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:54.151006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:54.161606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1240/2483] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:54.378054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616c70-9de5-4c74-bc45-9b9435b7578c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:35:54.387616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616c70-9de5-4c74-bc45-9b9435b7578c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:35:54.391963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabda0d-43ba-4657-a822-837a8e6228b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:35:54.392587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabda0d-43ba-4657-a822-837a8e6228b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:35:54.392866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabda0d-43ba-4657-a822-837a8e6228b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:35:54.393137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabda0d-43ba-4657-a822-837a8e6228b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:35:54.398218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:54.451316 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabda0d-43ba-4657-a822-837a8e6228b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:35:54.453046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabda0d-43ba-4657-a822-837a8e6228b2 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:35:54.462641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1244/2484] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:35:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:04.157196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:04.458610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=24 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:33.062887 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:33.168309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25ecd7-a009-4da7-b7a1-63dfe99e2119 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:33.172918 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:33.173705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:33.173990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:33.174267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] PATH_INFO: `/v3/users/a2694371872243d499a156f6387377f6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:33.175432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2694371872243d499a156f6387377f6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:33.177384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:33.371821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2694371872243d499a156f6387377f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:33.372519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2694371872243d499a156f6387377f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:33.384434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2694371872243d499a156f6387377f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:33.391868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2694371872243d499a156f6387377f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:33.392536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2694371872243d499a156f6387377f6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:33.471055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1241/2485] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:33 2022] DELETE /identity/v3/users/a2694371872243d499a156f6387377f6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:33.475788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac736c-8dac-4144-9229-747626105798 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:33.476333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac736c-8dac-4144-9229-747626105798 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:33.476433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac736c-8dac-4144-9229-747626105798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:33.527122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a1ac736c-8dac-4144-9229-747626105798 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:33.528462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a1ac736c-8dac-4144-9229-747626105798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:33.585042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1245/2486] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:33.594834 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:33.596230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:33.638675 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:33.670393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b0f58-3df6-4e26-a1ba-3e6ce07319ca admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:33.675570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:33.676289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:33.676579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:33.676883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:33.687165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:33.688652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:33.697946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1242/2487] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:34.118833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac736c-8dac-4144-9229-747626105798 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:34.121451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a1ac736c-8dac-4144-9229-747626105798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:34.132665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac736c-8dac-4144-9229-747626105798 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:34.137601 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:34.138290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:34.138738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:34.139101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] PATH_INFO: `/v3/projects/71e1ec324d4b4452b7b442b66dae46e9` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:34.140346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e1ec324d4b4452b7b442b66dae46e9)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:34.142272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:34.255686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e1ec324d4b4452b7b442b66dae46e9', 'request_id': 'req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.261866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e1ec324d4b4452b7b442b66dae46e9', 'request_id': 'req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.356997 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e1ec324d4b4452b7b442b66dae46e9', 'request_id': 'req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.368816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] The token cache is being invalidate because project 71e1ec324d4b4452b7b442b66dae46e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:34.369038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.369667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.371497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1246/2488] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:34 2022] DELETE /identity/v3/projects/71e1ec324d4b4452b7b442b66dae46e9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:34.375955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:34.385654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298d77-898b-47f5-9cd1-90bba6f95f36 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:34.441348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:34.441980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:34.442263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:34.442543 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] PATH_INFO: `/v3/users/80eed98c012a4447912e0e8917816ac5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:34.443657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80eed98c012a4447912e0e8917816ac5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:34.445626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:34.609353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80eed98c012a4447912e0e8917816ac5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.610021 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80eed98c012a4447912e0e8917816ac5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.622336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80eed98c012a4447912e0e8917816ac5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.629283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80eed98c012a4447912e0e8917816ac5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.635895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-88b7a0ee-721e-4978-8707-88240c929c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80eed98c012a4447912e0e8917816ac5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:34.733170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1243/2489] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:34 2022] DELETE /identity/v3/users/80eed98c012a4447912e0e8917816ac5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:35.147192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:35.147192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:35.159221 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295cf41-b96b-4b5a-b4c2-edc7ba21d1ff admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:35.214441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:35.220878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:35.221651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.221915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.222192 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] PATH_INFO: `/v3/projects/ead85e95fb544473bfb87524f4b7c653` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.223310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead85e95fb544473bfb87524f4b7c653)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:35.225292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:35.312082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead85e95fb544473bfb87524f4b7c653', 'request_id': 'req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:35.317681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead85e95fb544473bfb87524f4b7c653', 'request_id': 'req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:35.384623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead85e95fb544473bfb87524f4b7c653', 'request_id': 'req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:35.395899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] The token cache is being invalidate because project ead85e95fb544473bfb87524f4b7c653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:35.396186 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:35.396836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b68b8ffd-2001-4708-9693-1b7a0e8ec1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:35.398372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1247/2490] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:35 2022] DELETE /identity/v3/projects/ead85e95fb544473bfb87524f4b7c653 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:35.404748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f03a-8096-4b9a-badf-352113934f9b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.404748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f03a-8096-4b9a-badf-352113934f9b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.404748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f03a-8096-4b9a-badf-352113934f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.451739 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7994f03a-8096-4b9a-badf-352113934f9b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:35.452984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7994f03a-8096-4b9a-badf-352113934f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:35.466158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:35.512526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1244/2491] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:35.521621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e997-7527-4604-8e8b-be9f0167d3a2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.521910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e997-7527-4604-8e8b-be9f0167d3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.522184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820e997-7527-4604-8e8b-be9f0167d3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.543584 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7820e997-7527-4604-8e8b-be9f0167d3a2 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:35.544898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7820e997-7527-4604-8e8b-be9f0167d3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:35.552827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1248/2492] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:35.557205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994f03a-8096-4b9a-badf-352113934f9b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:35.566891 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994f03a-8096-4b9a-badf-352113934f9b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:35.571987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:35.572619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.572902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.573175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.573824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:36:35.574125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:35.575722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:35.586998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1245/2493] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:36:35.592121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e997-7527-4604-8e8b-be9f0167d3a2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:35.601475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820e997-7527-4604-8e8b-be9f0167d3a2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:35.606790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:35.607379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.607657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.607927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.608581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:35.610466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:35.684338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1249/2494] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:35 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:36:35.688531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:35.699262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2492248-a5a4-4cd0-aac3-1844de982f17 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:35.754336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:35.754939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.755219 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.755508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.756105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:35.758051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:35.864831 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1246/2495] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:35 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:35.869104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:35.880009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e541d-c0f5-4835-bb31-56d4ef4dd8d9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:35.884742 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:35.885366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.885648 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.885927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.887266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:35.888893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:35.898730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1250/2496] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:35.903864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:35.914474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf482a50-d40d-4f52-91ad-09505806c2ee admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:35.919153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3052e06-1013-43cf-9a64-2d9af853874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:35.919749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3052e06-1013-43cf-9a64-2d9af853874e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.920033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3052e06-1013-43cf-9a64-2d9af853874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.920341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3052e06-1013-43cf-9a64-2d9af853874e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.920989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3052e06-1013-43cf-9a64-2d9af853874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:35.922584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3052e06-1013-43cf-9a64-2d9af853874e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:35.933068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1247/2497] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:35.937128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:35.946861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c27f4-d219-44ab-899d-ef3ab6b507c4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:35.952019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:35.952692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:35.952977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:35.953254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] PATH_INFO: `/v3/projects/e5494f7d86844542a44796dfc9f3ded4/users/eeba913bbedd4c7da7ba27ddc45df888/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:35.968360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5494f7d86844542a44796dfc9f3ded4, user_id=eeba913bbedd4c7da7ba27ddc45df888, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:35.971008 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.048748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1251/2498] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:35 2022] PUT /identity/v3/projects/e5494f7d86844542a44796dfc9f3ded4/users/eeba913bbedd4c7da7ba27ddc45df888/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:36.059396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476e05-7dab-4c3c-b584-891dcc10f87c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.059726 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476e05-7dab-4c3c-b584-891dcc10f87c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.060008 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476e05-7dab-4c3c-b584-891dcc10f87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.088532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5c476e05-7dab-4c3c-b584-891dcc10f87c None None] MFA Rules not processed for user `eeba913bbedd4c7da7ba27ddc45df888`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:36.092252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5c476e05-7dab-4c3c-b584-891dcc10f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:36.154013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1248/2499] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:36.158528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:36.221735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8edc5c-9a66-468e-91ec-14fa58f57b3e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:36.226558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:36.227168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.227450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.227726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.228396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:36.230372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.312866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1252/2500] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:36 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:36.316988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c476e05-7dab-4c3c-b584-891dcc10f87c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:36.329039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c476e05-7dab-4c3c-b584-891dcc10f87c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:36.340765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:36.387621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:36.388647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.389053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.389501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.390346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:36.393328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.470971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1249/2501] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:36 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:36.475085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:36.486038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f6620-9637-4207-9bba-9347509ba128 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:36.490732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:36.491315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.491624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.491869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.492547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:36.494128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.496984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:36.506068 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1253/2502] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:36.510277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:36.520520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa690e-60f0-4f08-918e-4fea0ccaf303 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:36.525145 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:36.525794 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.526081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.526361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] PATH_INFO: `/v3/projects/c34b3b940c1f4b0bbede334e11a0262d/users/c7765ed5c57f400b8bf9653879ae8a61/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.541473 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34b3b940c1f4b0bbede334e11a0262d, user_id=c7765ed5c57f400b8bf9653879ae8a61, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:36.545101 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.603452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1250/2503] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:36 2022] PUT /identity/v3/projects/c34b3b940c1f4b0bbede334e11a0262d/users/c7765ed5c57f400b8bf9653879ae8a61/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:36:36.608166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:36.618100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5ee86-9550-4d6c-8c30-c1c903a1ea81 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:36.677284 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d9e44-9994-4c3f-895b-3da63f4bcad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:36.677901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9e44-9994-4c3f-895b-3da63f4bcad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.678187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9e44-9994-4c3f-895b-3da63f4bcad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.678465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9e44-9994-4c3f-895b-3da63f4bcad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.679112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9e44-9994-4c3f-895b-3da63f4bcad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:36.680779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9e44-9994-4c3f-895b-3da63f4bcad0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.691708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1254/2504] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:36.696003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:36.707273 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda065a7-10b9-412e-9968-ac13d95ae07c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:36.713985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:36.714830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.715199 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.715502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] PATH_INFO: `/v3/projects/c34b3b940c1f4b0bbede334e11a0262d/users/c7765ed5c57f400b8bf9653879ae8a61/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.717480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34b3b940c1f4b0bbede334e11a0262d, user_id=c7765ed5c57f400b8bf9653879ae8a61, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:36.724905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.731191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1251/2505] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:36 2022] PUT /identity/v3/projects/c34b3b940c1f4b0bbede334e11a0262d/users/c7765ed5c57f400b8bf9653879ae8a61/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:36.741724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a880-7645-4df7-acbb-193ec84aaf0c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.742019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a880-7645-4df7-acbb-193ec84aaf0c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.742297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a880-7645-4df7-acbb-193ec84aaf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.770757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f9c0a880-7645-4df7-acbb-193ec84aaf0c None None] MFA Rules not processed for user `c7765ed5c57f400b8bf9653879ae8a61`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:36.771992 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f9c0a880-7645-4df7-acbb-193ec84aaf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:36.841916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1255/2506] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:36.853329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:36.855806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:36.913443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23663f7-6fed-4102-b9a2-18047fc924a1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:36.917210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cde24-be25-4452-a382-45af39ee8632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:36.918391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cde24-be25-4452-a382-45af39ee8632 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:36.918670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cde24-be25-4452-a382-45af39ee8632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:36.918944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cde24-be25-4452-a382-45af39ee8632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:36.927902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cde24-be25-4452-a382-45af39ee8632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:36.929369 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cde24-be25-4452-a382-45af39ee8632 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:36.938512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1252/2507] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:37.854005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0a880-7645-4df7-acbb-193ec84aaf0c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:37.916400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0a880-7645-4df7-acbb-193ec84aaf0c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:37.921480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:37.922103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:37.922384 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:37.922659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] PATH_INFO: `/v3/users/eeba913bbedd4c7da7ba27ddc45df888` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:37.923769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeba913bbedd4c7da7ba27ddc45df888)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:37.925718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:37.947562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:38.092283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeba913bbedd4c7da7ba27ddc45df888'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:38.092953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeba913bbedd4c7da7ba27ddc45df888'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:38.110817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeba913bbedd4c7da7ba27ddc45df888'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:38.110817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeba913bbedd4c7da7ba27ddc45df888'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:38.168484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeba913bbedd4c7da7ba27ddc45df888'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:38.181405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1256/2508] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:37 2022] DELETE /identity/v3/users/eeba913bbedd4c7da7ba27ddc45df888 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:38.186106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:38.186574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:38.186768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:38.208426 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:38.210365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:38.275958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1253/2509] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:36:38.286864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:38.288491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:38.350596 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368460d3-e441-4dc8-858c-c90cc76581ba admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:38.354130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:38.354726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:38.355006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:38.355277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:38.365053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:38.366405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:38.376142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1257/2510] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:38.810406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:38.811842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:38.824256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2a37f-93f3-4282-ab31-ac2ae24b43ca None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:38.829949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:38.830591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:38.830881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:38.831157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] PATH_INFO: `/v3/projects/e5494f7d86844542a44796dfc9f3ded4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:38.832314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5494f7d86844542a44796dfc9f3ded4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:38.834223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:38.841596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:38.945795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5494f7d86844542a44796dfc9f3ded4', 'request_id': 'req-aa38ee2a-948a-4502-b922-a215076012ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:38.952001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5494f7d86844542a44796dfc9f3ded4', 'request_id': 'req-aa38ee2a-948a-4502-b922-a215076012ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:38.958121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5494f7d86844542a44796dfc9f3ded4', 'request_id': 'req-aa38ee2a-948a-4502-b922-a215076012ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.048094 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] The token cache is being invalidate because project e5494f7d86844542a44796dfc9f3ded4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:39.048418 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.049050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.050568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1254/2511] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:38 2022] DELETE /identity/v3/projects/e5494f7d86844542a44796dfc9f3ded4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:39.060918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:39.065166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d8748-e70e-402a-92ac-b7a4fdd64150 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:39.121521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:39.122726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:39.123048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:39.123329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] PATH_INFO: `/v3/users/c7765ed5c57f400b8bf9653879ae8a61` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:39.124799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7765ed5c57f400b8bf9653879ae8a61)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:39.126719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:39.323155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:39.326388 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7765ed5c57f400b8bf9653879ae8a61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.327082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7765ed5c57f400b8bf9653879ae8a61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.339775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7765ed5c57f400b8bf9653879ae8a61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.341210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7765ed5c57f400b8bf9653879ae8a61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.410727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3654cde7-cbe1-44be-83bd-7cc724e0107b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7765ed5c57f400b8bf9653879ae8a61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:39.423902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1258/2512] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:39 2022] DELETE /identity/v3/users/c7765ed5c57f400b8bf9653879ae8a61 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:39.847215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:39.847215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:39.866942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ee2a-948a-4502-b922-a215076012ee admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:39.938956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:39.939595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:39.939881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:39.940157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] PATH_INFO: `/v3/projects/c34b3b940c1f4b0bbede334e11a0262d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:39.941313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34b3b940c1f4b0bbede334e11a0262d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:39.943210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:40.032888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34b3b940c1f4b0bbede334e11a0262d', 'request_id': 'req-2334d04a-ab25-4a8c-8b9b-c062a86d8898'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:40.038317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34b3b940c1f4b0bbede334e11a0262d', 'request_id': 'req-2334d04a-ab25-4a8c-8b9b-c062a86d8898'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:40.045563 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34b3b940c1f4b0bbede334e11a0262d', 'request_id': 'req-2334d04a-ab25-4a8c-8b9b-c062a86d8898'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:40.105283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] The token cache is being invalidate because project c34b3b940c1f4b0bbede334e11a0262d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:40.105501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:40.106111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2334d04a-ab25-4a8c-8b9b-c062a86d8898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:40.108629 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1255/2513] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:39 2022] DELETE /identity/v3/projects/c34b3b940c1f4b0bbede334e11a0262d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:40.114440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4767e6-07f6-483b-af1d-8d189b50f023 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.114963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4767e6-07f6-483b-af1d-8d189b50f023 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.114963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4767e6-07f6-483b-af1d-8d189b50f023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.135692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4a4767e6-07f6-483b-af1d-8d189b50f023 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:40.136940 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4a4767e6-07f6-483b-af1d-8d189b50f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:40.199902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1259/2514] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:40.208031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ca20-db6f-4bd8-b429-cc3d8898eca7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.208385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ca20-db6f-4bd8-b429-cc3d8898eca7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.208638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811ca20-db6f-4bd8-b429-cc3d8898eca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.228383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f811ca20-db6f-4bd8-b429-cc3d8898eca7 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:40.229654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f811ca20-db6f-4bd8-b429-cc3d8898eca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:40.238420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1256/2515] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:40.242783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4767e6-07f6-483b-af1d-8d189b50f023 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:40.253653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4767e6-07f6-483b-af1d-8d189b50f023 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:40.258497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:40.259103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.259387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.259666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.260352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:36:40.260662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:40.262300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:40.274494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1260/2516] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:36:40.279480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811ca20-db6f-4bd8-b429-cc3d8898eca7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:40.288919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811ca20-db6f-4bd8-b429-cc3d8898eca7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:40.293725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:40.296243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.296243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.296243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.296676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:40.298260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:40.314741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:40.408818 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1257/2517] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:40 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:40.413055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:40.423799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622779-e8f3-4854-aa7a-7f5029aa190f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:40.478650 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:40.479254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.479560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.479840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.480589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:40.483353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:40.585427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1261/2518] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:40 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:40.589801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:40.601742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d1562-5316-47d7-a2c2-98a2371b4545 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:40.607625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:40.608291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.608598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.608873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.609545 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:40.611190 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:40.621364 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1258/2519] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:40.625759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:40.635712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b3795-3c78-4b6b-b95e-24ef851acfac admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:40.640527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b67f4-2955-457b-af8c-e048330af2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:40.641128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b67f4-2955-457b-af8c-e048330af2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.641411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b67f4-2955-457b-af8c-e048330af2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.641688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b67f4-2955-457b-af8c-e048330af2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.642392 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b67f4-2955-457b-af8c-e048330af2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:40.643981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b67f4-2955-457b-af8c-e048330af2a7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:40.655145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1262/2520] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:40.659208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:40.669850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f9091-a3a8-4ed8-9860-f7fa6341c606 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:40.674592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:40.675241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.675592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.675873 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] PATH_INFO: `/v3/projects/49d9af0a6f184487b022b8f9c4fada98/users/ed86761a9ed34963861a1637a02e24d2/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.690287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d9af0a6f184487b022b8f9c4fada98, user_id=ed86761a9ed34963861a1637a02e24d2, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:40.692980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:40.762853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1259/2521] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:40 2022] PUT /identity/v3/projects/49d9af0a6f184487b022b8f9c4fada98/users/ed86761a9ed34963861a1637a02e24d2/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:36:40.773177 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810572-b7c2-4ccc-ae65-e3a3e4724f96 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.773462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810572-b7c2-4ccc-ae65-e3a3e4724f96 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.773758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810572-b7c2-4ccc-ae65-e3a3e4724f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.802536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-07810572-b7c2-4ccc-ae65-e3a3e4724f96 None None] MFA Rules not processed for user `ed86761a9ed34963861a1637a02e24d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:40.803732 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-07810572-b7c2-4ccc-ae65-e3a3e4724f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:40.816190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:40.868448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1263/2522] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:40.873212 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:40.938160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887692-a73e-4b96-8536-807a636efcfc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:40.942943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:40.943566 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:40.943851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:40.944130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:40.944808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:40.946762 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:41.073074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1260/2523] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:40 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:41.077871 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07810572-b7c2-4ccc-ae65-e3a3e4724f96 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:41.089730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07810572-b7c2-4ccc-ae65-e3a3e4724f96 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:41.152090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:41.152780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.153013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.153337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.153980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:41.156087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:41.266389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1264/2524] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:41 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:41.270411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:41.281752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9810f0b-4f8c-40a0-82bf-8e1b73a8bd9e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:41.286347 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:41.286987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.287268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.287541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.288180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:41.289791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:41.301464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1261/2525] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:36:41.305634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:41.315435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658a9a1-151f-4b3a-962d-75cbc17bd9cc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:41.319934 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:41.320611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.320891 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.321166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] PATH_INFO: `/v3/projects/3591518a658245ed8e2df1b3d33e89c9/users/02962af173cc4c9ca8fa8bac21c565f3/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.335272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3591518a658245ed8e2df1b3d33e89c9, user_id=02962af173cc4c9ca8fa8bac21c565f3, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:41.337959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:41.420984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1265/2526] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:41 2022] PUT /identity/v3/projects/3591518a658245ed8e2df1b3d33e89c9/users/02962af173cc4c9ca8fa8bac21c565f3/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:41.425137 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:41.436480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5f7e-3374-47bd-b02f-254116be9a8c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:41.491534 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1efe3c-0b47-4a08-b5c6-53090877184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:41.492052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1efe3c-0b47-4a08-b5c6-53090877184d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.492365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1efe3c-0b47-4a08-b5c6-53090877184d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.492660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1efe3c-0b47-4a08-b5c6-53090877184d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.493302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1efe3c-0b47-4a08-b5c6-53090877184d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:41.494881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1efe3c-0b47-4a08-b5c6-53090877184d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:41.504551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1262/2527] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:41.508681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:41.519028 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52a26-ee5e-4648-b57e-9deba5d296e1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:41.523598 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:41.524266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.524549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.524821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] PATH_INFO: `/v3/projects/3591518a658245ed8e2df1b3d33e89c9/users/02962af173cc4c9ca8fa8bac21c565f3/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.526710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3591518a658245ed8e2df1b3d33e89c9, user_id=02962af173cc4c9ca8fa8bac21c565f3, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:41.530224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:41.540368 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1266/2528] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:41 2022] PUT /identity/v3/projects/3591518a658245ed8e2df1b3d33e89c9/users/02962af173cc4c9ca8fa8bac21c565f3/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:41.552962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52ef7-cd04-4f99-a837-25c13caec843 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.553275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52ef7-cd04-4f99-a837-25c13caec843 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.553553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52ef7-cd04-4f99-a837-25c13caec843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.581331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f0b52ef7-cd04-4f99-a837-25c13caec843 None None] MFA Rules not processed for user `02962af173cc4c9ca8fa8bac21c565f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:41.582539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f0b52ef7-cd04-4f99-a837-25c13caec843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:41.600928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:41.652697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1263/2529] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:41.664655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:41.666354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:41.726560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ca106-7ced-4876-a776-3541039ed5cd admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:41.730167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c4a36-20cd-428c-96ca-599a9a26d6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:41.730772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c4a36-20cd-428c-96ca-599a9a26d6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.731053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c4a36-20cd-428c-96ca-599a9a26d6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.731344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c4a36-20cd-428c-96ca-599a9a26d6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.740260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c4a36-20cd-428c-96ca-599a9a26d6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:41.741747 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c4a36-20cd-428c-96ca-599a9a26d6a6 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:41.751320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1267/2530] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:41.780569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b52ef7-cd04-4f99-a837-25c13caec843 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:41.843789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b52ef7-cd04-4f99-a837-25c13caec843 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:41.848469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:41.849099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:41.849383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:41.849659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] PATH_INFO: `/v3/users/ed86761a9ed34963861a1637a02e24d2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:41.850817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed86761a9ed34963861a1637a02e24d2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:41.852783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:42.010237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed86761a9ed34963861a1637a02e24d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.010912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed86761a9ed34963861a1637a02e24d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.023302 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed86761a9ed34963861a1637a02e24d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.030801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed86761a9ed34963861a1637a02e24d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.031462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed86761a9ed34963861a1637a02e24d2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.093743 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1264/2531] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:41 2022] DELETE /identity/v3/users/ed86761a9ed34963861a1637a02e24d2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:42.098403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:42.098692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:42.098969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:42.117737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:42.118931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:42.124924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:42.182506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1268/2532] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:42.192937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:42.195291 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:42.237318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:42.254864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db962e-f342-4da2-acb1-f1e08e909785 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:42.258857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:42.259523 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:42.260181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:42.260181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:42.271159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:42.272576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:42.282215 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1265/2533] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:42.691521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:42.693084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:42.707064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20622-890d-40ef-a97a-1b3441063352 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:42.711817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:42.712579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:42.712929 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:42.713208 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] PATH_INFO: `/v3/projects/49d9af0a6f184487b022b8f9c4fada98` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:42.714987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d9af0a6f184487b022b8f9c4fada98)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:42.717391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:42.821501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d9af0a6f184487b022b8f9c4fada98', 'request_id': 'req-67dbb19a-34ea-4fc4-99fb-6412d1a892be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.827079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d9af0a6f184487b022b8f9c4fada98', 'request_id': 'req-67dbb19a-34ea-4fc4-99fb-6412d1a892be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.915872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d9af0a6f184487b022b8f9c4fada98', 'request_id': 'req-67dbb19a-34ea-4fc4-99fb-6412d1a892be'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.928366 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] The token cache is being invalidate because project 49d9af0a6f184487b022b8f9c4fada98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:42.928659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.929283 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:42.930885 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1269/2534] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:42 2022] DELETE /identity/v3/projects/49d9af0a6f184487b022b8f9c4fada98 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:42.935113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:42.944919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d358a-9af5-46b2-9076-49c7cf304732 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:43.001099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:43.001734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:43.002019 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:43.002298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] PATH_INFO: `/v3/users/02962af173cc4c9ca8fa8bac21c565f3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:43.003432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02962af173cc4c9ca8fa8bac21c565f3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:43.005392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:43.172081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02962af173cc4c9ca8fa8bac21c565f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:43.172791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02962af173cc4c9ca8fa8bac21c565f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:43.185586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02962af173cc4c9ca8fa8bac21c565f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:43.192436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02962af173cc4c9ca8fa8bac21c565f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:43.193106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24a33b3f-dd89-4fc9-aa2a-4004d8329cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02962af173cc4c9ca8fa8bac21c565f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:43.242483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1266/2535] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:42 2022] DELETE /identity/v3/users/02962af173cc4c9ca8fa8bac21c565f3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:43.746324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:43.749229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:43.762581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb19a-34ea-4fc4-99fb-6412d1a892be admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:43.819989 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:43.820646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:43.820924 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:43.821194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] PATH_INFO: `/v3/projects/3591518a658245ed8e2df1b3d33e89c9` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:43.822300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3591518a658245ed8e2df1b3d33e89c9)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:43.824205 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:43.925879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:43.933976 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3591518a658245ed8e2df1b3d33e89c9', 'request_id': 'req-11a4349e-c60b-4903-a92c-be9e9db3cfcd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:43.940101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3591518a658245ed8e2df1b3d33e89c9', 'request_id': 'req-11a4349e-c60b-4903-a92c-be9e9db3cfcd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:44.007204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3591518a658245ed8e2df1b3d33e89c9', 'request_id': 'req-11a4349e-c60b-4903-a92c-be9e9db3cfcd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:44.018847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] The token cache is being invalidate because project 3591518a658245ed8e2df1b3d33e89c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:44.020594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:44.020594 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-11a4349e-c60b-4903-a92c-be9e9db3cfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:44.021519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1270/2536] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:43 2022] DELETE /identity/v3/projects/3591518a658245ed8e2df1b3d33e89c9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:44.026520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c6d0-e3b8-4d40-9912-8659707b4ef6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.026812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c6d0-e3b8-4d40-9912-8659707b4ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.027091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c6d0-e3b8-4d40-9912-8659707b4ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.047062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2f59c6d0-e3b8-4d40-9912-8659707b4ef6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:44.048295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2f59c6d0-e3b8-4d40-9912-8659707b4ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:44.097827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:44.107340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1267/2537] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:44.115142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed248a2-8c87-401f-b6be-909301cd3172 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.115500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed248a2-8c87-401f-b6be-909301cd3172 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.115841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed248a2-8c87-401f-b6be-909301cd3172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.136154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1ed248a2-8c87-401f-b6be-909301cd3172 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:44.137452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1ed248a2-8c87-401f-b6be-909301cd3172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:44.145452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1271/2538] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:44.150737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c6d0-e3b8-4d40-9912-8659707b4ef6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.160649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c6d0-e3b8-4d40-9912-8659707b4ef6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.165102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.165698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.165983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.166254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.166904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:36:44.167208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.169509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:44.181472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1268/2539] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:36:44.186602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed248a2-8c87-401f-b6be-909301cd3172 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.195791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed248a2-8c87-401f-b6be-909301cd3172 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.200525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.201203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.201480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.201757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.202389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.204337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:44.285215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1272/2540] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:44 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:36:44.289407 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.300612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19db626-8edd-4a6a-84db-4388ea84bafd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.355981 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.356618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.356907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.357186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.358565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.360562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:44.464141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1269/2541] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:44 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:44.468828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.479507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031588-1cc2-420b-a626-63837109aaa8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.484745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.485374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.485686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.485959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.486597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.488193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:44.497911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1273/2542] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:44.502078 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.511815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2572f07-e1b4-4cfb-9855-66ac99a06e10 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.516620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2693dce-1b22-4567-82f0-0c7a4a8de8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.517207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693dce-1b22-4567-82f0-0c7a4a8de8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.517487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693dce-1b22-4567-82f0-0c7a4a8de8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.517760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2693dce-1b22-4567-82f0-0c7a4a8de8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.518389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2693dce-1b22-4567-82f0-0c7a4a8de8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.519974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2693dce-1b22-4567-82f0-0c7a4a8de8c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:44.530755 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1270/2543] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:44.534720 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.544844 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dafb1-815f-42b0-ab08-07f419c5eff9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.550132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.550832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.551119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.551426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] PATH_INFO: `/v3/projects/9b7d1fd0a7554e3582273fe2db6bf68b/users/1a76f32463e642d5a62d7585c7f0bc06/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.565728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7d1fd0a7554e3582273fe2db6bf68b, user_id=1a76f32463e642d5a62d7585c7f0bc06, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.568444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:44.635549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1274/2544] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:44 2022] PUT /identity/v3/projects/9b7d1fd0a7554e3582273fe2db6bf68b/users/1a76f32463e642d5a62d7585c7f0bc06/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:44.646371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd309e5-7f1d-446a-8a86-a4f20b0648f9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.646662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd309e5-7f1d-446a-8a86-a4f20b0648f9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.647030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd309e5-7f1d-446a-8a86-a4f20b0648f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.675311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1dd309e5-7f1d-446a-8a86-a4f20b0648f9 None None] MFA Rules not processed for user `1a76f32463e642d5a62d7585c7f0bc06`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:44.676557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1dd309e5-7f1d-446a-8a86-a4f20b0648f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:44.738940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1271/2545] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:44.743643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.807439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff22c07-833a-4426-a771-27a8a5b4601f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.812020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.812654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.812942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.813216 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.813988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.815883 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:44.900614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1275/2546] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:44 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:36:44.904719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd309e5-7f1d-446a-8a86-a4f20b0648f9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:44.916128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd309e5-7f1d-446a-8a86-a4f20b0648f9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:44.962195 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:44.971270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:44.976704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:44.976704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:44.976704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:44.976704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:44.976704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:45.054356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1272/2547] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:44 2022] POST /identity/v3/users => generated 301 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:45.058662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:45.070277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cf724-2bae-461c-adec-1b27deb4f443 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:45.075539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:45.076731 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:45.077044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:45.077880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:45.078802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:45.080475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:45.092964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1276/2548] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:36:45.097236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:45.107377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c963df-5a29-4b9b-a5cf-16b01427cf71 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:45.112575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:45.113233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:45.113513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:45.113786 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] PATH_INFO: `/v3/projects/5a9b798e701d4e4c9de8625c90359423/users/bc84467e881f4336924ee360d2ff65d6/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:45.131542 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9b798e701d4e4c9de8625c90359423, user_id=bc84467e881f4336924ee360d2ff65d6, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:45.134376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:45.272451 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1273/2549] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:45 2022] PUT /identity/v3/projects/5a9b798e701d4e4c9de8625c90359423/users/bc84467e881f4336924ee360d2ff65d6/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:36:45.276482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:45.287280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefbc8c-830e-4968-a052-7a10b83ccce4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:45.323220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:45.347218 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749a5eb-b50e-45dc-b794-6639d7195b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:45.347866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749a5eb-b50e-45dc-b794-6639d7195b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:45.348150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749a5eb-b50e-45dc-b794-6639d7195b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:45.348516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749a5eb-b50e-45dc-b794-6639d7195b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:45.349110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749a5eb-b50e-45dc-b794-6639d7195b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:45.350703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749a5eb-b50e-45dc-b794-6639d7195b48 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:45.361901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1277/2550] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:45.371550 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:45.377076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506fa3-65bf-4fe0-af6e-4de63d147f4a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:45.381708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:45.382371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:45.382652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:45.382934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] PATH_INFO: `/v3/projects/5a9b798e701d4e4c9de8625c90359423/users/bc84467e881f4336924ee360d2ff65d6/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:45.384876 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9b798e701d4e4c9de8625c90359423, user_id=bc84467e881f4336924ee360d2ff65d6, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:45.387501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:45.399197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1274/2551] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:45 2022] PUT /identity/v3/projects/5a9b798e701d4e4c9de8625c90359423/users/bc84467e881f4336924ee360d2ff65d6/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:45.411209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a008-2d45-464b-ade9-450f1cb74165 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:45.411501 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a008-2d45-464b-ade9-450f1cb74165 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:45.411782 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a008-2d45-464b-ade9-450f1cb74165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:45.439336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4fb3a008-2d45-464b-ade9-450f1cb74165 None None] MFA Rules not processed for user `bc84467e881f4336924ee360d2ff65d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:45.440589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4fb3a008-2d45-464b-ade9-450f1cb74165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:45.510604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1278/2552] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:45.522118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:45.524030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:45.584166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba78a2f-6f39-4f59-8a67-7c338fb59ac3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:45.587778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a509c92-76b5-4d66-b4ce-a8346340bb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:45.588425 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509c92-76b5-4d66-b4ce-a8346340bb2e service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:45.588711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509c92-76b5-4d66-b4ce-a8346340bb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:45.588990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509c92-76b5-4d66-b4ce-a8346340bb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:45.599652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a509c92-76b5-4d66-b4ce-a8346340bb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:45.601124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a509c92-76b5-4d66-b4ce-a8346340bb2e service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:45.611203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1275/2553] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:45.747682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3a008-2d45-464b-ade9-450f1cb74165 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:45.810141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3a008-2d45-464b-ade9-450f1cb74165 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:45.814768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:45.815443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:45.815733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:45.816011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] PATH_INFO: `/v3/users/1a76f32463e642d5a62d7585c7f0bc06` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:45.817171 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a76f32463e642d5a62d7585c7f0bc06)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:45.819122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:46.027450 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a76f32463e642d5a62d7585c7f0bc06'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.028055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a76f32463e642d5a62d7585c7f0bc06'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.036621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:46.040919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a76f32463e642d5a62d7585c7f0bc06'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.041551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a76f32463e642d5a62d7585c7f0bc06'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.110449 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a76f32463e642d5a62d7585c7f0bc06'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.122933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1279/2554] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:45 2022] DELETE /identity/v3/users/1a76f32463e642d5a62d7585c7f0bc06 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:46.127937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:46.128242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:46.128617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:46.149390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:46.150574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:46.209842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1276/2555] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:46.219372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:46.220925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:46.277394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720225e-47ae-4a86-8537-1e68c1a95987 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:46.281912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:46.282523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:46.282803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:46.283074 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:46.291818 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:46.293317 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:46.304615 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1280/2556] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:46.747240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:46.749626 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:46.764096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e855cd-4a10-4dc8-bc6c-104a058284df None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:46.769886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:46.770532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:46.770816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:46.771121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] PATH_INFO: `/v3/projects/9b7d1fd0a7554e3582273fe2db6bf68b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:46.772237 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7d1fd0a7554e3582273fe2db6bf68b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:46.778429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:46.881231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:46.884840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7d1fd0a7554e3582273fe2db6bf68b', 'request_id': 'req-bb7f04b9-2769-451f-81ca-fdf3b28b5105'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.890709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7d1fd0a7554e3582273fe2db6bf68b', 'request_id': 'req-bb7f04b9-2769-451f-81ca-fdf3b28b5105'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.897142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7d1fd0a7554e3582273fe2db6bf68b', 'request_id': 'req-bb7f04b9-2769-451f-81ca-fdf3b28b5105'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.955738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] The token cache is being invalidate because project 9b7d1fd0a7554e3582273fe2db6bf68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:46.956141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.956711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:46.958223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1277/2557] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:46 2022] DELETE /identity/v3/projects/9b7d1fd0a7554e3582273fe2db6bf68b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:46.962203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:46.972231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a9a8-d350-4e82-8e86-530f6fda24b8 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:47.029497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:47.030129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:47.030412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:47.030688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] PATH_INFO: `/v3/users/bc84467e881f4336924ee360d2ff65d6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:47.031817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc84467e881f4336924ee360d2ff65d6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:47.033781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:47.193805 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc84467e881f4336924ee360d2ff65d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.194379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc84467e881f4336924ee360d2ff65d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.206963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc84467e881f4336924ee360d2ff65d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.207806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc84467e881f4336924ee360d2ff65d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.293152 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-feb2bf69-deda-4e93-81d2-2e6100f85b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc84467e881f4336924ee360d2ff65d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.302595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:47.307571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1281/2558] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:46 2022] DELETE /identity/v3/users/bc84467e881f4336924ee360d2ff65d6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:47.701056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:47.703730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:47.720433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f04b9-2769-451f-81ca-fdf3b28b5105 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:47.778803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:47.779453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:47.779712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:47.779989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] PATH_INFO: `/v3/projects/5a9b798e701d4e4c9de8625c90359423` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:47.781771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9b798e701d4e4c9de8625c90359423)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:47.783670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:47.886903 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9b798e701d4e4c9de8625c90359423', 'request_id': 'req-8c26b49e-6c01-4f7a-947a-694980dc5543'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.892854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9b798e701d4e4c9de8625c90359423', 'request_id': 'req-8c26b49e-6c01-4f7a-947a-694980dc5543'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.899068 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9b798e701d4e4c9de8625c90359423', 'request_id': 'req-8c26b49e-6c01-4f7a-947a-694980dc5543'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.972521 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] The token cache is being invalidate because project 5a9b798e701d4e4c9de8625c90359423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:47.972744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.973366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8c26b49e-6c01-4f7a-947a-694980dc5543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:47.974844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1278/2559] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:47 2022] DELETE /identity/v3/projects/5a9b798e701d4e4c9de8625c90359423 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:47.979781 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb8afa-b594-4585-88b9-33b34f0ead95 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:47.980273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb8afa-b594-4585-88b9-33b34f0ead95 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:47.980385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb8afa-b594-4585-88b9-33b34f0ead95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.000470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-edfb8afa-b594-4585-88b9-33b34f0ead95 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:48.001677 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-edfb8afa-b594-4585-88b9-33b34f0ead95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:48.060468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1282/2560] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:36:48.068682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57feca-bda3-4f79-a184-a4a81e449e6d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.068968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57feca-bda3-4f79-a184-a4a81e449e6d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.069244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57feca-bda3-4f79-a184-a4a81e449e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.089032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ab57feca-bda3-4f79-a184-a4a81e449e6d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:48.090214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab57feca-bda3-4f79-a184-a4a81e449e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:48.100581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1279/2561] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:48.104815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb8afa-b594-4585-88b9-33b34f0ead95 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.114739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb8afa-b594-4585-88b9-33b34f0ead95 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.119211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.119798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.120078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.120458 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.121104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:36:48.121411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.122984 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:48.137973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1283/2562] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:36:48.140788 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57feca-bda3-4f79-a184-a4a81e449e6d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.150076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57feca-bda3-4f79-a184-a4a81e449e6d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.155081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.155706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.156010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.156308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.156945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.158898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:48.257238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1280/2563] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:48 2022] POST /identity/v3/projects => generated 409 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:48.261333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.272053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c4081-c8e6-438c-9282-3a013c0a89f9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.330333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.330939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.331214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.331485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.332110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.334043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:48.419809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1284/2564] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:48 2022] POST /identity/v3/users => generated 305 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:48.424741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.434964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fc045-48e2-4121-8e23-128c7ff9ac30 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.440470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.441075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.441353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.441681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.442294 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.443882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:48.454183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1281/2565] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:48.458462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.468641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c8db-9e77-4036-a043-a5201863ac9a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.473418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad8e0e-ce5d-4248-931b-a7888ef5fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.474010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad8e0e-ce5d-4248-931b-a7888ef5fa4f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.474294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad8e0e-ce5d-4248-931b-a7888ef5fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.474573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad8e0e-ce5d-4248-931b-a7888ef5fa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.475214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad8e0e-ce5d-4248-931b-a7888ef5fa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.476880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad8e0e-ce5d-4248-931b-a7888ef5fa4f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:48.487337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1285/2566] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:48.491377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.502122 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daec10-f05c-4cd1-a38c-9bd5c64b6e52 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.506734 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.507429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.507657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.507932 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] PATH_INFO: `/v3/projects/cacc98144f71494697715aee77cc0d64/users/86b040ef12854252a421941cb130dbd9/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.522069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacc98144f71494697715aee77cc0d64, user_id=86b040ef12854252a421941cb130dbd9, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.524749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:48.597771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:48.602985 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1282/2567] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:48 2022] PUT /identity/v3/projects/cacc98144f71494697715aee77cc0d64/users/86b040ef12854252a421941cb130dbd9/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:48.614309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51254c16-4616-4720-8336-ab26657748ce None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.614641 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51254c16-4616-4720-8336-ab26657748ce None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.614961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51254c16-4616-4720-8336-ab26657748ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.645429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-51254c16-4616-4720-8336-ab26657748ce None None] MFA Rules not processed for user `86b040ef12854252a421941cb130dbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:48.646656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-51254c16-4616-4720-8336-ab26657748ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:48.702736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:48.712499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1286/2568] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:48.717007 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.778327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8b002-ce5f-46e6-bc7a-e3b4371f876d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.783686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.784323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.784609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.784886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.785516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.787409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:48.878223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1283/2569] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:48 2022] POST /identity/v3/projects => generated 407 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:48.882102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51254c16-4616-4720-8336-ab26657748ce None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:48.893009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51254c16-4616-4720-8336-ab26657748ce None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:48.950075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:48.950680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:48.950962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:48.951238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:48.951866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:48.953822 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:49.031391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1287/2570] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:48 2022] POST /identity/v3/users => generated 310 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:49.035396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:49.045584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f29ee-328d-4b2b-a750-56429473e9f4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:49.050944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:49.051582 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:49.051872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:49.052146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:49.052888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:49.054501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:49.065920 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1284/2571] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:49.070215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:49.080132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9994-7c02-4507-a30d-da58e88e9f02 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:49.084739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:49.085381 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:49.085664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:49.085941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] PATH_INFO: `/v3/projects/8275ce72cd6c4ea8b587cece29cddb10/users/59fa0fbcbda743d7a3f76c403f26fc8a/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:49.100770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8275ce72cd6c4ea8b587cece29cddb10, user_id=59fa0fbcbda743d7a3f76c403f26fc8a, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:49.103377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:49.209469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1288/2572] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:49 2022] PUT /identity/v3/projects/8275ce72cd6c4ea8b587cece29cddb10/users/59fa0fbcbda743d7a3f76c403f26fc8a/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:36:49.213340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:49.224390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddef69d-1a4c-4503-8ab1-6b128fa93e44 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:49.281098 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8218c5-aa9f-47ec-a7d3-73d0ec55b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:49.281795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8218c5-aa9f-47ec-a7d3-73d0ec55b26a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:49.282071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8218c5-aa9f-47ec-a7d3-73d0ec55b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:49.282346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8218c5-aa9f-47ec-a7d3-73d0ec55b26a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:49.282984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8218c5-aa9f-47ec-a7d3-73d0ec55b26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:49.284613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8218c5-aa9f-47ec-a7d3-73d0ec55b26a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:49.294224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1285/2573] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:49.298609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:49.309079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a7e11-cc10-4481-88c5-3455bd599f43 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:49.314039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:49.314690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:49.314975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:49.315252 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] PATH_INFO: `/v3/projects/8275ce72cd6c4ea8b587cece29cddb10/users/59fa0fbcbda743d7a3f76c403f26fc8a/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:49.317229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8275ce72cd6c4ea8b587cece29cddb10, user_id=59fa0fbcbda743d7a3f76c403f26fc8a, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:49.319873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:49.330802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1289/2574] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:49 2022] PUT /identity/v3/projects/8275ce72cd6c4ea8b587cece29cddb10/users/59fa0fbcbda743d7a3f76c403f26fc8a/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:49.396896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6280a9-1163-4b06-bb5a-b9904d91c52d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:49.400894 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6280a9-1163-4b06-bb5a-b9904d91c52d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:49.400894 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6280a9-1163-4b06-bb5a-b9904d91c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:49.425537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9d6280a9-1163-4b06-bb5a-b9904d91c52d None None] MFA Rules not processed for user `59fa0fbcbda743d7a3f76c403f26fc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:49.426784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d6280a9-1163-4b06-bb5a-b9904d91c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:49.485135 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:49.494965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1286/2575] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:49 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:49.507005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:49.508694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:49.567685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822d4de-af9f-4ce9-ade2-437df5b6b5af admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:49.571289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:49.571910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:49.572190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:49.572484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:49.582120 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:49.583543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:49.592794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1290/2576] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:49 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:49.948801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6280a9-1163-4b06-bb5a-b9904d91c52d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:49.958795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6280a9-1163-4b06-bb5a-b9904d91c52d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:49.962387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8bb6a-17c5-4ae5-978d-b35876b753e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:49.962987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8bb6a-17c5-4ae5-978d-b35876b753e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:49.963269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8bb6a-17c5-4ae5-978d-b35876b753e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:49.963546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8bb6a-17c5-4ae5-978d-b35876b753e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:50.019960 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8bb6a-17c5-4ae5-978d-b35876b753e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:50.021495 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8bb6a-17c5-4ae5-978d-b35876b753e0 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:50.030942 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1287/2577] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:56.704868 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:56.760622 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:56.774424 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e325-8a09-4838-a9ea-557a36c1470a service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:56.779094 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:56.779715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:56.779993 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:56.780498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] PATH_INFO: `/v3/users/86b040ef12854252a421941cb130dbd9` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:56.781890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b040ef12854252a421941cb130dbd9)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:56.783931 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:56.936495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b040ef12854252a421941cb130dbd9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:56.937838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b040ef12854252a421941cb130dbd9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:56.949809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b040ef12854252a421941cb130dbd9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:56.950435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b040ef12854252a421941cb130dbd9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:56.990292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b040ef12854252a421941cb130dbd9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:57.004587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1291/2578] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:56 2022] DELETE /identity/v3/users/86b040ef12854252a421941cb130dbd9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:57.009253 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:57.009766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:57.009872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:57.028767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:57.029984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:57.088751 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1288/2579] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:57.099232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:57.100649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:57.178819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4d20-4951-4b4a-bef1-cb954f8c20cb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:57.182464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:57.183064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:57.183420 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:57.183699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:57.193315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:57.194828 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:57.204820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1292/2580] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:36:57.591120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:57.592641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:57.605652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1cf53-ddd8-4d71-b3b4-82960328eb4b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:57.611600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:57.612293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:57.612586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:57.612861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] PATH_INFO: `/v3/projects/cacc98144f71494697715aee77cc0d64` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:57.613982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacc98144f71494697715aee77cc0d64)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:57.616164 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:57.710952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacc98144f71494697715aee77cc0d64', 'request_id': 'req-3e0bef8d-1b5c-4872-81a0-ca776141d32d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:57.716416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacc98144f71494697715aee77cc0d64', 'request_id': 'req-3e0bef8d-1b5c-4872-81a0-ca776141d32d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:57.722712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacc98144f71494697715aee77cc0d64', 'request_id': 'req-3e0bef8d-1b5c-4872-81a0-ca776141d32d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:57.824436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] The token cache is being invalidate because project cacc98144f71494697715aee77cc0d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:57.824729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:57.825354 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:57.826858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1289/2581] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:57 2022] DELETE /identity/v3/projects/cacc98144f71494697715aee77cc0d64 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:57.831055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:57.840706 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fc927-04e5-45cb-bd0c-f9da1baa5da8 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:57.888075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:57.897722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:57.898346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:57.898629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:57.898905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] PATH_INFO: `/v3/users/59fa0fbcbda743d7a3f76c403f26fc8a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:57.900019 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fa0fbcbda743d7a3f76c403f26fc8a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:57.901987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:58.130302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fa0fbcbda743d7a3f76c403f26fc8a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.130963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fa0fbcbda743d7a3f76c403f26fc8a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.142990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fa0fbcbda743d7a3f76c403f26fc8a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.143639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fa0fbcbda743d7a3f76c403f26fc8a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.219524 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed4a48ce-398b-471b-8484-a3fb5eccbe84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fa0fbcbda743d7a3f76c403f26fc8a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.233447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1293/2582] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:36:57 2022] DELETE /identity/v3/users/59fa0fbcbda743d7a3f76c403f26fc8a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:58.608130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:58.610670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:58.623907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bef8d-1b5c-4872-81a0-ca776141d32d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:58.636610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:58.682588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:58.683142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:58.683428 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:58.683699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] PATH_INFO: `/v3/projects/8275ce72cd6c4ea8b587cece29cddb10` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:58.684821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8275ce72cd6c4ea8b587cece29cddb10)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:58.687417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:58.789477 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8275ce72cd6c4ea8b587cece29cddb10', 'request_id': 'req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.795085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8275ce72cd6c4ea8b587cece29cddb10', 'request_id': 'req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.801988 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8275ce72cd6c4ea8b587cece29cddb10', 'request_id': 'req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.885829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] The token cache is being invalidate because project 8275ce72cd6c4ea8b587cece29cddb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:36:58.886121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.886746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6bf744eb-d10c-4f5e-9f14-d1c859e85d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:36:58.888272 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1290/2583] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:58 2022] DELETE /identity/v3/projects/8275ce72cd6c4ea8b587cece29cddb10 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:36:58.894093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11acc2d-4ca6-496e-8451-3479a47c994c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:58.894561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11acc2d-4ca6-496e-8451-3479a47c994c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:58.894674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11acc2d-4ca6-496e-8451-3479a47c994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:58.915860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a11acc2d-4ca6-496e-8451-3479a47c994c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:58.919787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a11acc2d-4ca6-496e-8451-3479a47c994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:58.976364 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1294/2584] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:58.984684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c6808-ad08-4c51-a491-fdec6cc51b36 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:58.984977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c6808-ad08-4c51-a491-fdec6cc51b36 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:58.985254 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c6808-ad08-4c51-a491-fdec6cc51b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.005972 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2b1c6808-ad08-4c51-a491-fdec6cc51b36 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:59.007177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2b1c6808-ad08-4c51-a491-fdec6cc51b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:59.015760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1291/2585] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:59.019998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11acc2d-4ca6-496e-8451-3479a47c994c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.029478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11acc2d-4ca6-496e-8451-3479a47c994c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.034644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.035251 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.035536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.035959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.036525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:36:59.036832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.038459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:59.050563 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1295/2586] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:36:59.054842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c6808-ad08-4c51-a491-fdec6cc51b36 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.064646 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c6808-ad08-4c51-a491-fdec6cc51b36 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.069348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.069945 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.070227 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.070503 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.071124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.073047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:59.175656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1292/2587] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:59 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:59.180064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.191299 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad098-bd88-416e-8725-ca530080e0e3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.243530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:59.249390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.250037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.250337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.250611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.251246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.253300 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:59.362200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1296/2588] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:59 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:36:59.366452 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.378096 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a7ce8-1da9-4ed3-b914-6a45c58199d7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.382690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.383285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.383569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.383961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.384736 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.386333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:59.397207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1293/2589] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:59.401502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.411824 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db3cb2-db90-4901-9cbd-960cc4d9359f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.416519 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bddf5-1801-490b-a9e3-7886d80d63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.417107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bddf5-1801-490b-a9e3-7886d80d63a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.417385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bddf5-1801-490b-a9e3-7886d80d63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.417656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bddf5-1801-490b-a9e3-7886d80d63a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.418344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bddf5-1801-490b-a9e3-7886d80d63a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.419926 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bddf5-1801-490b-a9e3-7886d80d63a2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:59.430998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1297/2590] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:36:59.434707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.445277 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff40bb-dd4d-4a39-98e8-5928b9091d0a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.449829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.450463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.450742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.451015 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] PATH_INFO: `/v3/projects/652309f5c4f34ab4abb15376fdfcffd1/users/dfb245db4cb84f3f9f0305cd25436eb2/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.466944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652309f5c4f34ab4abb15376fdfcffd1, user_id=dfb245db4cb84f3f9f0305cd25436eb2, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.469886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:59.538685 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1294/2591] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:36:59 2022] PUT /identity/v3/projects/652309f5c4f34ab4abb15376fdfcffd1/users/dfb245db4cb84f3f9f0305cd25436eb2/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:36:59.550764 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de88dc-45ce-4f98-8077-f4294f96720e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.551051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de88dc-45ce-4f98-8077-f4294f96720e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.551356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de88dc-45ce-4f98-8077-f4294f96720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.580400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-46de88dc-45ce-4f98-8077-f4294f96720e None None] MFA Rules not processed for user `dfb245db4cb84f3f9f0305cd25436eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:36:59.581624 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-46de88dc-45ce-4f98-8077-f4294f96720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:36:59.645092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1298/2592] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:36:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:36:59.649552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.694162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:59.711384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c8f1a-0c84-4d97-b05f-1fd226107b08 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.716056 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.716688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.716968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.717256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.718696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.720767 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:36:59.815356 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1295/2593] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:36:59 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:36:59.820044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de88dc-45ce-4f98-8077-f4294f96720e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:36:59.831431 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de88dc-45ce-4f98-8077-f4294f96720e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:36:59.888148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:36:59.888806 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:36:59.889082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:36:59.890082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:36:59.890714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:36:59.892766 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:00.002846 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1299/2594] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:36:59 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:37:00.006796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:00.017855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee633a-8927-47e8-adc2-587923d649f0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:00.022417 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:00.023014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:00.023296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:00.023572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:00.024241 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:00.025997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:00.036539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1296/2595] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:37:00.040639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:00.050728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46698f41-4a38-49fd-9e5d-be6e69b1fba1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:00.055276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:00.055915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:00.056195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:00.056516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] PATH_INFO: `/v3/projects/f16858e7ff574d5d993ff766f6df58f7/users/80d3bd418b7d43ebba8d96c8ddb367bb/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:00.071659 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16858e7ff574d5d993ff766f6df58f7, user_id=80d3bd418b7d43ebba8d96c8ddb367bb, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:00.074254 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:00.174124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1300/2596] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:37:00 2022] PUT /identity/v3/projects/f16858e7ff574d5d993ff766f6df58f7/users/80d3bd418b7d43ebba8d96c8ddb367bb/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:00.178316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:00.188855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08629-71af-4a09-aacf-dcc893fd4c1e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:00.251355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54cc73-33fe-4349-8a83-c81362792aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:00.251996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cc73-33fe-4349-8a83-c81362792aad admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:00.252338 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cc73-33fe-4349-8a83-c81362792aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:00.252621 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cc73-33fe-4349-8a83-c81362792aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:00.253306 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54cc73-33fe-4349-8a83-c81362792aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:00.254994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54cc73-33fe-4349-8a83-c81362792aad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:00.265765 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1297/2597] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:37:00.270358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:00.280783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53e2c3-b111-4359-aa8d-f8846a304687 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:00.285763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:00.286710 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:00.287031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:00.287320 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] PATH_INFO: `/v3/projects/f16858e7ff574d5d993ff766f6df58f7/users/80d3bd418b7d43ebba8d96c8ddb367bb/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:00.289297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16858e7ff574d5d993ff766f6df58f7, user_id=80d3bd418b7d43ebba8d96c8ddb367bb, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:00.291972 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:00.302686 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1301/2598] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:37:00 2022] PUT /identity/v3/projects/f16858e7ff574d5d993ff766f6df58f7/users/80d3bd418b7d43ebba8d96c8ddb367bb/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:00.313686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1abd4-5878-4162-baf8-4bae2cd5e2f3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:00.313975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1abd4-5878-4162-baf8-4bae2cd5e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:00.314255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1abd4-5878-4162-baf8-4bae2cd5e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:00.341899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b6b1abd4-5878-4162-baf8-4bae2cd5e2f3 None None] MFA Rules not processed for user `80d3bd418b7d43ebba8d96c8ddb367bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:00.343039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6b1abd4-5878-4162-baf8-4bae2cd5e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:00.409210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1298/2599] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:37:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:00.419576 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:00.422016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:00.444566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:00.501969 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d8d4-1212-4666-92e7-38ec1d3f7fb8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:00.505664 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:00.506276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:00.506560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:00.506839 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:00.561267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:00.563356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:00.572204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1302/2600] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:37:05.907120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1abd4-5878-4162-baf8-4bae2cd5e2f3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:05.917392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1abd4-5878-4162-baf8-4bae2cd5e2f3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:05.921086 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bfc1b-45cd-4893-97ba-2940583ee733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:05.921714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bfc1b-45cd-4893-97ba-2940583ee733 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:05.922763 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bfc1b-45cd-4893-97ba-2940583ee733 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:05.923080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bfc1b-45cd-4893-97ba-2940583ee733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:05.932861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bfc1b-45cd-4893-97ba-2940583ee733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:05.934463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bfc1b-45cd-4893-97ba-2940583ee733 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:05.945328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1299/2601] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:37:10.568147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=49 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:12.915091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:12.999053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7115-8c8f-4841-9a7c-6fbef124fb98 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:13.004725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:13.005357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:13.005635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:13.005905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] PATH_INFO: `/v3/users/dfb245db4cb84f3f9f0305cd25436eb2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:13.007021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb245db4cb84f3f9f0305cd25436eb2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:13.008954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:13.211888 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb245db4cb84f3f9f0305cd25436eb2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:13.212568 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb245db4cb84f3f9f0305cd25436eb2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:13.226896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb245db4cb84f3f9f0305cd25436eb2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:13.227653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb245db4cb84f3f9f0305cd25436eb2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:13.310721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb245db4cb84f3f9f0305cd25436eb2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:13.328530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1303/2602] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:37:12 2022] DELETE /identity/v3/users/dfb245db4cb84f3f9f0305cd25436eb2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:13.333233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:13.333917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:13.333917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:13.356265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:13.357462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:13.388095 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:13.397010 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:13.398833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:13.439171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1300/2603] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:13.450039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:13.451965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:13.474302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497639e5-b639-44c8-aa7b-bfb95a082b6c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:13.478000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:13.478628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:13.478914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:13.479191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:13.481052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:13.530262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7134b-62b6-4150-8c94-8d8f8e79902b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:13.533534 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:13.535043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:13.535812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:13.536109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:13.536411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:13.546309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:13.547869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:13.558315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1301/2604] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:37:13.561176 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:13.563963 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:13.574290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1304/2605] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:37:14.025517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:14.026984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:14.045388 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad506c04-5c69-451e-a5a2-3035d652a1b8 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:14.050578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:14.051203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:14.051487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:14.051776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] PATH_INFO: `/v3/projects/652309f5c4f34ab4abb15376fdfcffd1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:14.052934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=652309f5c4f34ab4abb15376fdfcffd1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:14.055660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:14.331833 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652309f5c4f34ab4abb15376fdfcffd1', 'request_id': 'req-54e80731-64f0-45fd-9c77-1158f85a1e2b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.337742 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652309f5c4f34ab4abb15376fdfcffd1', 'request_id': 'req-54e80731-64f0-45fd-9c77-1158f85a1e2b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.348395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652309f5c4f34ab4abb15376fdfcffd1', 'request_id': 'req-54e80731-64f0-45fd-9c77-1158f85a1e2b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.447382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] The token cache is being invalidate because project 652309f5c4f34ab4abb15376fdfcffd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:37:14.447851 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.448518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.449993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1302/2606] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:37:14 2022] DELETE /identity/v3/projects/652309f5c4f34ab4abb15376fdfcffd1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:14.455038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:14.465719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d4ca-1729-4316-a8bd-900071083d7c service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:14.530189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:14.530841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:14.531169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:14.531651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] PATH_INFO: `/v3/users/80d3bd418b7d43ebba8d96c8ddb367bb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:14.532945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d3bd418b7d43ebba8d96c8ddb367bb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:14.534974 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:14.730780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d3bd418b7d43ebba8d96c8ddb367bb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.731448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d3bd418b7d43ebba8d96c8ddb367bb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.747234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d3bd418b7d43ebba8d96c8ddb367bb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.748461 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d3bd418b7d43ebba8d96c8ddb367bb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.836305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d3bd418b7d43ebba8d96c8ddb367bb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:14.850348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1305/2607] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:37:14 2022] DELETE /identity/v3/users/80d3bd418b7d43ebba8d96c8ddb367bb => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:37:15.422695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:15.425459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:15.451801 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80731-64f0-45fd-9c77-1158f85a1e2b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:15.516632 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:15.529871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:15.530825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:15.531377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:15.531859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] PATH_INFO: `/v3/projects/f16858e7ff574d5d993ff766f6df58f7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:15.533461 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16858e7ff574d5d993ff766f6df58f7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:15.536620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:15.698114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16858e7ff574d5d993ff766f6df58f7', 'request_id': 'req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:15.712318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16858e7ff574d5d993ff766f6df58f7', 'request_id': 'req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:15.719525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16858e7ff574d5d993ff766f6df58f7', 'request_id': 'req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:15.841827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] The token cache is being invalidate because project f16858e7ff574d5d993ff766f6df58f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:37:15.842323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:15.842966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:15.856327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1303/2608] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:37:15 2022] DELETE /identity/v3/projects/f16858e7ff574d5d993ff766f6df58f7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:20.010910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:20.012340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:20.077253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:20.113579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe8501-7118-4741-981e-c4d5fac81958 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:20.172751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94ce15-c558-4889-8944-ce73557e845c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:20.174222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ce15-c558-4889-8944-ce73557e845c service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:20.174506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ce15-c558-4889-8944-ce73557e845c service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:20.174779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ce15-c558-4889-8944-ce73557e845c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:20.176532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cd94ce15-c558-4889-8944-ce73557e845c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:20.187292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ce15-c558-4889-8944-ce73557e845c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:20.189807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ce15-c558-4889-8944-ce73557e845c service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:20.199333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1306/2609] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:37:23.092171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:23.093752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:23.156526 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54364a32-0449-4eaf-9a3e-3eac7ef8b15c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:23.161541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:23.162178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:23.162483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:23.162759 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:23.164576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:23.228416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:23.229881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:23.239882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1304/2610] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:37:25.866841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:25.867493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:25.867493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:25.903950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:25.905494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:25.975102 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1307/2611] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:37:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:26.120192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:26.121670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:26.170457 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:26.214162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44934f6-0560-4601-bdcc-8243212d02f8 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:26.219884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:26.225329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:26.225329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:26.225329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:26.237312 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:26.241416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:26.253757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1305/2612] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:28.056167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:28.057901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:28.089711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cbc1d-b860-4ca1-91c5-c2368bf45fa2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:28.106064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:28.107087 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:28.107538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:28.107815 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:28.113655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:28.140453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:28.142202 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:28.165156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1308/2613] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:37:33.093955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:33.097000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:33.138581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b144ce9-97ac-496a-94eb-618d3385c12f service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:33.152744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:33.153478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:33.153935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:33.154296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] PATH_INFO: `/v3/users/f6b68c05d7bc4a9391c3cf69c61ca776` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:33.155624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b68c05d7bc4a9391c3cf69c61ca776)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:33.158206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:33.361384 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b68c05d7bc4a9391c3cf69c61ca776'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:33.362276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b68c05d7bc4a9391c3cf69c61ca776'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:33.385280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b68c05d7bc4a9391c3cf69c61ca776'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:33.399408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b68c05d7bc4a9391c3cf69c61ca776'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:33.400299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b68c05d7bc4a9391c3cf69c61ca776'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:33.456541 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1306/2614] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:37:33 2022] DELETE /identity/v3/users/f6b68c05d7bc4a9391c3cf69c61ca776 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:33.752623 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:33.770831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f330941-e6b6-423b-ba9b-270f3f80e970 service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:33.826480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:33.845029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:33.845756 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:33.846040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:33.846652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] PATH_INFO: `/v3/projects/54b67231c062403fb81d64a28c012eee` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:33.848238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b67231c062403fb81d64a28c012eee)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:33.851538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:33.974709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b67231c062403fb81d64a28c012eee', 'request_id': 'req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:33.982024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b67231c062403fb81d64a28c012eee', 'request_id': 'req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.064153 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b67231c062403fb81d64a28c012eee', 'request_id': 'req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.077762 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] The token cache is being invalidate because project 54b67231c062403fb81d64a28c012eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:37:34.078050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.079403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.081018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1309/2615] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:37:33 2022] DELETE /identity/v3/projects/54b67231c062403fb81d64a28c012eee => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:34.085459 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:34.087714 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:34.102856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302594-76ec-4411-bcbf-6b3be807abea admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:34.174355 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:34.175006 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:34.175350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:34.175874 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] PATH_INFO: `/v3/users/46de3b4e82ad4e3694acc7aa3d3e1cc5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:34.178282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46de3b4e82ad4e3694acc7aa3d3e1cc5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:34.179841 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:34.367888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:34.383708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46de3b4e82ad4e3694acc7aa3d3e1cc5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.384487 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46de3b4e82ad4e3694acc7aa3d3e1cc5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.404619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46de3b4e82ad4e3694acc7aa3d3e1cc5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.419004 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46de3b4e82ad4e3694acc7aa3d3e1cc5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.419849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46de3b4e82ad4e3694acc7aa3d3e1cc5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:34.758992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1307/2616] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:37:34 2022] DELETE /identity/v3/users/46de3b4e82ad4e3694acc7aa3d3e1cc5 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:34.759715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:34.759715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:34.779697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6ad7-9e20-4e54-9500-d0e5a6eb2c93 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:34.831245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:34.831896 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:34.832179 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:34.832494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:34.834455 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:34.882597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:34.903274 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:34.970730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:34.970730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1310/2617] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:37:35.374962 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:35.377243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:35.392892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55784c9-d82c-488f-8a5e-4d5cbe6b2b8b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:35.397266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:35.397983 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:35.398353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:35.398702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] PATH_INFO: `/v3/projects/89897c981904483e9385f33e5dc2c785` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:35.399935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89897c981904483e9385f33e5dc2c785)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:35.402010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:35.539953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89897c981904483e9385f33e5dc2c785', 'request_id': 'req-0dbc2239-d23a-4495-9c16-8be121e712a2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:35.548288 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89897c981904483e9385f33e5dc2c785', 'request_id': 'req-0dbc2239-d23a-4495-9c16-8be121e712a2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:35.555298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89897c981904483e9385f33e5dc2c785', 'request_id': 'req-0dbc2239-d23a-4495-9c16-8be121e712a2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:35.660317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] The token cache is being invalidate because project 89897c981904483e9385f33e5dc2c785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:37:35.665423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:35.665423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:35.665423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1308/2618] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:37:35 2022] DELETE /identity/v3/projects/89897c981904483e9385f33e5dc2c785 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:39.734435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:39.739173 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:39.756640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd24a0-6926-4b9d-8b02-5d53fc79a0f0 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:39.828237 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:39.829104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:39.829561 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:39.829908 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] PATH_INFO: `/v3/users/2e6a7791b6464326a588553b2e6cf715` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:39.831180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6a7791b6464326a588553b2e6cf715)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:39.833441 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:40.112881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6a7791b6464326a588553b2e6cf715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.113542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6a7791b6464326a588553b2e6cf715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.126609 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6a7791b6464326a588553b2e6cf715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.127259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6a7791b6464326a588553b2e6cf715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.268746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1b357094-ab49-49b5-80e8-d4bb4d243a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6a7791b6464326a588553b2e6cf715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.284836 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1311/2619] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:37:39 2022] DELETE /identity/v3/users/2e6a7791b6464326a588553b2e6cf715 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:40.540609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:40.542605 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:40.557458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2239-d23a-4495-9c16-8be121e712a2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:40.619050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:40.619601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:40.619884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:40.620154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] PATH_INFO: `/v3/projects/60ec2c778f064a6faebbecbcf071f743` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:40.621298 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ec2c778f064a6faebbecbcf071f743)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:40.623552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:40.723850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:40.732316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ec2c778f064a6faebbecbcf071f743', 'request_id': 'req-e3993812-3147-4704-afb2-feb906100650'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.737708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ec2c778f064a6faebbecbcf071f743', 'request_id': 'req-e3993812-3147-4704-afb2-feb906100650'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.744204 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ec2c778f064a6faebbecbcf071f743', 'request_id': 'req-e3993812-3147-4704-afb2-feb906100650'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.822969 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] The token cache is being invalidate because project 60ec2c778f064a6faebbecbcf071f743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:37:40.823255 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.823890 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e3993812-3147-4704-afb2-feb906100650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:37:40.825403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1309/2620] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:37:40 2022] DELETE /identity/v3/projects/60ec2c778f064a6faebbecbcf071f743 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:37:40.830832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cc16-6e91-4900-b4a5-7a8cba80160f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:40.831382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cc16-6e91-4900-b4a5-7a8cba80160f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:40.831382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cc16-6e91-4900-b4a5-7a8cba80160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:40.851506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0ce2cc16-6e91-4900-b4a5-7a8cba80160f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:40.852737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0ce2cc16-6e91-4900-b4a5-7a8cba80160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:40.902981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:40.911962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1312/2621] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:40.919567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba949ec-cd1a-4387-9262-802f5652f2df None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:40.919861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba949ec-cd1a-4387-9262-802f5652f2df None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:40.920153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba949ec-cd1a-4387-9262-802f5652f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:40.942398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7ba949ec-cd1a-4387-9262-802f5652f2df None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:40.942398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7ba949ec-cd1a-4387-9262-802f5652f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:40.950039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1310/2622] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:40.954377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2cc16-6e91-4900-b4a5-7a8cba80160f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:40.964016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2cc16-6e91-4900-b4a5-7a8cba80160f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:40.968639 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:40.969281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:40.972259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:40.972259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:40.972259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:37:40.972259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:40.972723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:40.983491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1313/2623] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:37:40.988533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba949ec-cd1a-4387-9262-802f5652f2df None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:40.997907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba949ec-cd1a-4387-9262-802f5652f2df None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:41.003387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:41.003979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:41.004287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:41.004568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:41.005205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:41.007091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:41.087826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1311/2624] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:37:40 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:37:41.092128 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:41.102730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfcde3-da28-4ba8-9f4b-e46060743299 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:41.163697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:41.164255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:41.164542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:41.164813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:41.165498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:41.167479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:41.253600 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1314/2625] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:37:41 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:37:41.258083 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:41.269064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccc3a-5e07-478d-8c39-13b99e60fbff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:41.273727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:41.274383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:41.274662 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:41.274935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:41.275571 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:41.277206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:41.288147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1312/2626] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:37:41.292369 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:41.303575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bb53-e38f-4c6a-8558-1d39042f24be admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:41.308406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502ecd6-5da0-404b-8893-1f12ec617bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:41.308803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ecd6-5da0-404b-8893-1f12ec617bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:41.309081 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ecd6-5da0-404b-8893-1f12ec617bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:41.309355 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ecd6-5da0-404b-8893-1f12ec617bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:41.310002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502ecd6-5da0-404b-8893-1f12ec617bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:41.311573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502ecd6-5da0-404b-8893-1f12ec617bdd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:41.322723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1315/2627] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:37:41.326952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:41.337200 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba19b68-9384-4e45-990e-5732f2bc135c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:41.341997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:41.346782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:41.346782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:41.346782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] PATH_INFO: `/v3/projects/6a4686f248ec45ef8973a0f370e065a7/users/a580c24eab0a41ceb5dbca37af5e0b40/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:41.358619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4686f248ec45ef8973a0f370e065a7, user_id=a580c24eab0a41ceb5dbca37af5e0b40, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:41.362181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:41.429724 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1313/2628] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:37:41 2022] PUT /identity/v3/projects/6a4686f248ec45ef8973a0f370e065a7/users/a580c24eab0a41ceb5dbca37af5e0b40/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:37:41.434808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0202-132e-41bf-aab5-c6cb31d3b3ab None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:41.435100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0202-132e-41bf-aab5-c6cb31d3b3ab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:41.435385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0202-132e-41bf-aab5-c6cb31d3b3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:41.455688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2d5a0202-132e-41bf-aab5-c6cb31d3b3ab None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:41.457078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2d5a0202-132e-41bf-aab5-c6cb31d3b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:41.519474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1316/2629] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:41.529711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:41.532144 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:41.592299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9b65-1a49-41cd-aa0f-85d21f6e1e96 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:41.597340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:41.598026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:41.598381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:41.598652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:41.609699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:41.611157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:41.620817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1314/2630] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:37:47.525348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a1f7f-d80d-4aac-96bd-3eb5b7aee16f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:47.525975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a1f7f-d80d-4aac-96bd-3eb5b7aee16f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:47.525975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a1f7f-d80d-4aac-96bd-3eb5b7aee16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:47.561469 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4e7a1f7f-d80d-4aac-96bd-3eb5b7aee16f None None] MFA Rules not processed for user `a580c24eab0a41ceb5dbca37af5e0b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:47.563359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4e7a1f7f-d80d-4aac-96bd-3eb5b7aee16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:47.632723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:47.643225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1317/2631] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:37:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:47.658258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:47.659697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:47.725045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:47.754913 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223d24f-0cac-462f-b0be-1a21626828ce service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:47.760617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:47.761229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:47.766529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:47.766529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:47.770057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:47.771664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:47.780393 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1315/2632] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:37:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:37:49.912110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a2f76-9437-4714-852b-24f887fc8220 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:49.912663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a2f76-9437-4714-852b-24f887fc8220 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:49.912779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a2f76-9437-4714-852b-24f887fc8220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:49.937109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-502a2f76-9437-4714-852b-24f887fc8220 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:49.938681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-502a2f76-9437-4714-852b-24f887fc8220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:50.005259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1318/2633] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:37:50.039274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:37:50.040795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:50.132037 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e935625-b8aa-45bc-9e8f-5efa91b5f8bd service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:37:50.145013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b00e7c-8e66-45c0-9d42-b4a9be269882 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:37:50.145652 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b00e7c-8e66-45c0-9d42-b4a9be269882 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:50.145990 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b00e7c-8e66-45c0-9d42-b4a9be269882 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:50.146260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b00e7c-8e66-45c0-9d42-b4a9be269882 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:50.155866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b00e7c-8e66-45c0-9d42-b4a9be269882 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:37:50.158142 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b00e7c-8e66-45c0-9d42-b4a9be269882 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:37:50.170779 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1316/2634] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:50.237627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901639b-b53c-459f-aedd-edffe2ab52ed None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:37:50.237916 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901639b-b53c-459f-aedd-edffe2ab52ed None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:37:50.238247 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901639b-b53c-459f-aedd-edffe2ab52ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:37:50.258475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6901639b-b53c-459f-aedd-edffe2ab52ed None None] MFA Rules not processed for user `a580c24eab0a41ceb5dbca37af5e0b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:37:50.259803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6901639b-b53c-459f-aedd-edffe2ab52ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:37:50.268203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1319/2635] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:37:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:38:00.166888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=46 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:00.253335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=31 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:10.574707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbfa23-1fbc-4ebc-8519-92edc3dcafbe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:38:10.575202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbfa23-1fbc-4ebc-8519-92edc3dcafbe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:38:10.575303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbfa23-1fbc-4ebc-8519-92edc3dcafbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:38:10.595921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0ccbfa23-1fbc-4ebc-8519-92edc3dcafbe None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:38:10.597168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ccbfa23-1fbc-4ebc-8519-92edc3dcafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:38:10.604308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1317/2636] 10.222.0.86 () {58 vars in 967 bytes} [Thu Aug 18 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:38:10.617066 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901639b-b53c-459f-aedd-edffe2ab52ed None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:38:10.630175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901639b-b53c-459f-aedd-edffe2ab52ed None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:38:10.635497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:38:10.636113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:38:10.636527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:38:10.636813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:38:10.645965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:38:10.647620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:38:10.656165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1320/2637] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:38:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:38:20.590155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:20.652522 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:08.794927 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbfa23-1fbc-4ebc-8519-92edc3dcafbe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:08.805678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbfa23-1fbc-4ebc-8519-92edc3dcafbe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:08.809351 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:08.809944 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:08.810223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:08.810492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:08.812280 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:08.825766 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:08.827187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:08.837949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1318/2638] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:10.017970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:10.028379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb772-21ba-45de-b17b-c43344150495 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:10.032037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:10.032691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:10.032978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:10.033257 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:10.035055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:10.049085 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:10.050513 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:10.061446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1321/2639] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:17.272713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:17.281276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2942a7e-e140-40db-92e2-780a516a4d3c service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:17.284928 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:17.285520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:17.285803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:17.286077 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:17.287925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:17.299769 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:17.301492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:17.311460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1319/2640] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:20.056532 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:20.941521 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:20.943039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:20.957574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac464b10-037a-4168-96d1-86c782f4fda5 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:20.963135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:20.963758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:20.964038 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:20.964345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] PATH_INFO: `/v3/users/d1b917bdbd434b538893c060ad44ebd4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:20.978765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1b917bdbd434b538893c060ad44ebd4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:20.980789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:21.155025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1b917bdbd434b538893c060ad44ebd4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.155748 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1b917bdbd434b538893c060ad44ebd4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.170537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1b917bdbd434b538893c060ad44ebd4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.171193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1b917bdbd434b538893c060ad44ebd4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.238330 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-969827cd-1b03-4ec7-a97f-81a0c012688d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1b917bdbd434b538893c060ad44ebd4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.251830 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1322/2641] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:39:20 2022] DELETE /identity/v3/users/d1b917bdbd434b538893c060ad44ebd4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:21.495692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:21.507443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8238ad-902f-4288-a73f-b8e86309e138 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:21.566644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:21.567961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:21.568460 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:21.568747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] PATH_INFO: `/v3/projects/c2d6454c28f74ff8a3ba13cd03b9af18` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:21.579300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d6454c28f74ff8a3ba13cd03b9af18)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:21.581340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:21.690727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d6454c28f74ff8a3ba13cd03b9af18', 'request_id': 'req-ba3d7a59-067b-47f3-b630-68566c9c3601'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.697089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d6454c28f74ff8a3ba13cd03b9af18', 'request_id': 'req-ba3d7a59-067b-47f3-b630-68566c9c3601'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.703758 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d6454c28f74ff8a3ba13cd03b9af18', 'request_id': 'req-ba3d7a59-067b-47f3-b630-68566c9c3601'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.791645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] The token cache is being invalidate because project c2d6454c28f74ff8a3ba13cd03b9af18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:39:21.791940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.792590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ba3d7a59-067b-47f3-b630-68566c9c3601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:21.794109 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1320/2642] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:39:21 2022] DELETE /identity/v3/projects/c2d6454c28f74ff8a3ba13cd03b9af18 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:21.799051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70baee5-f510-485f-832f-162bf8df24ef None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:21.799428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70baee5-f510-485f-832f-162bf8df24ef None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:21.799709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70baee5-f510-485f-832f-162bf8df24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:21.826575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e70baee5-f510-485f-832f-162bf8df24ef None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:21.827790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e70baee5-f510-485f-832f-162bf8df24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:21.886536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1323/2643] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:21.894260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c626ed2-81fa-4841-aeb6-28f712b6bf04 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:21.894583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c626ed2-81fa-4841-aeb6-28f712b6bf04 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:21.894858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c626ed2-81fa-4841-aeb6-28f712b6bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:21.914476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5c626ed2-81fa-4841-aeb6-28f712b6bf04 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:21.915669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5c626ed2-81fa-4841-aeb6-28f712b6bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:21.924311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1321/2644] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:21.929006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70baee5-f510-485f-832f-162bf8df24ef None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:21.939131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70baee5-f510-485f-832f-162bf8df24ef None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:21.944147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:21.944966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:21.945411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:21.945788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:21.946542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:39:21.946996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:21.948757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:21.960874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1324/2645] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:39:21.965162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c626ed2-81fa-4841-aeb6-28f712b6bf04 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:21.975238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c626ed2-81fa-4841-aeb6-28f712b6bf04 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:21.980031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:21.980811 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:21.981087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:21.981362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:21.982027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:21.983951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.068243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1322/2646] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:39:21 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:22.072482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.082535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2046-c992-40d5-b5b9-1d004dba55f0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.126921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:22.138577 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.141183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.141183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.141183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.141183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.142307 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.216278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1325/2647] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:39:22 2022] POST /identity/v3/users => generated 303 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:39:22.220203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.232052 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f01af-5d3d-4d26-9fd0-3f2f791d7a50 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.236905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.237511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.237792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.238069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.238791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.241081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.251509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1323/2648] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:22.255925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.266209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfbf00-17fc-4a19-9cde-8a606c3810c2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.271099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb17d8b-7ec4-42e4-8c84-9d9b499f6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.271697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17d8b-7ec4-42e4-8c84-9d9b499f6272 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.272095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17d8b-7ec4-42e4-8c84-9d9b499f6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.272289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17d8b-7ec4-42e4-8c84-9d9b499f6272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.272933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb17d8b-7ec4-42e4-8c84-9d9b499f6272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.274540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb17d8b-7ec4-42e4-8c84-9d9b499f6272 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.285262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1326/2649] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:22.290157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.300267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc36b-b03b-4fde-93a0-a840e2d16f2c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.305764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.306389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.306671 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.306946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] PATH_INFO: `/v3/projects/601d1c08ca0843d48df89927b8f2f6ae/users/7ad4a17ac47745ff850cfc5ab9d85be4/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.309395 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:22.322846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601d1c08ca0843d48df89927b8f2f6ae, user_id=7ad4a17ac47745ff850cfc5ab9d85be4, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.325783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.419079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1324/2650] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:22 2022] PUT /identity/v3/projects/601d1c08ca0843d48df89927b8f2f6ae/users/7ad4a17ac47745ff850cfc5ab9d85be4/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:22.429798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f018-534b-4bbd-bcb5-e8941595d580 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.430113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f018-534b-4bbd-bcb5-e8941595d580 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.430407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f018-534b-4bbd-bcb5-e8941595d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.459788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d7a1f018-534b-4bbd-bcb5-e8941595d580 None None] MFA Rules not processed for user `7ad4a17ac47745ff850cfc5ab9d85be4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:22.461023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d7a1f018-534b-4bbd-bcb5-e8941595d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:22.524958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1327/2651] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:22.529678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.593780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf42ab2-ca35-4fa9-811a-fc51fb9a25d9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.598583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.599731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.600012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.600323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.600953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.602865 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.685609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1325/2652] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:39:22 2022] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:22.689912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1f018-534b-4bbd-bcb5-e8941595d580 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.701819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1f018-534b-4bbd-bcb5-e8941595d580 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.759041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.759643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.759921 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.760193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.760840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.762835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.838967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1328/2653] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:39:22 2022] POST /identity/v3/users => generated 308 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:22.843107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.854170 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f206c5-4767-4f80-99d1-86e382bc8938 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.858855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.859448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.859771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.860045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.860715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.862295 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.873365 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1326/2654] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:22.877649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.888626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a06d-af61-444d-9bc1-801295df1fec admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:22.893174 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:22.893817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:22.894100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:22.894372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] PATH_INFO: `/v3/projects/0b0a0a0c0d6f43a3a0cee1e3a65f12d3/users/105e942d95854dc1984275b535e3de54/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:22.909724 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0a0a0c0d6f43a3a0cee1e3a65f12d3, user_id=105e942d95854dc1984275b535e3de54, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:22.912755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:22.969755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1329/2655] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:22 2022] PUT /identity/v3/projects/0b0a0a0c0d6f43a3a0cee1e3a65f12d3/users/105e942d95854dc1984275b535e3de54/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:22.974048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:22.984014 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e6eb-a0b8-465f-b696-a8825e827eff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:23.040185 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef0008-d68b-48b3-a96f-406ea8335385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:23.040826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0008-d68b-48b3-a96f-406ea8335385 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:23.041110 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0008-d68b-48b3-a96f-406ea8335385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:23.041386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0008-d68b-48b3-a96f-406ea8335385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:23.042026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef0008-d68b-48b3-a96f-406ea8335385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:23.043612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef0008-d68b-48b3-a96f-406ea8335385 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:23.053618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1327/2656] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:23.057775 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:23.068860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713a051-210c-4d68-945d-22ca166683f0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:23.073540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:23.074187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:23.074470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:23.074759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] PATH_INFO: `/v3/projects/0b0a0a0c0d6f43a3a0cee1e3a65f12d3/users/105e942d95854dc1984275b535e3de54/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:23.076714 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0a0a0c0d6f43a3a0cee1e3a65f12d3, user_id=105e942d95854dc1984275b535e3de54, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:23.079367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:23.089489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1330/2657] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:23 2022] PUT /identity/v3/projects/0b0a0a0c0d6f43a3a0cee1e3a65f12d3/users/105e942d95854dc1984275b535e3de54/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:23.100852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931c12-1a5e-4a5d-9669-fedf64263d20 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:23.101141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931c12-1a5e-4a5d-9669-fedf64263d20 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:23.101420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931c12-1a5e-4a5d-9669-fedf64263d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:23.128965 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-04931c12-1a5e-4a5d-9669-fedf64263d20 None None] MFA Rules not processed for user `105e942d95854dc1984275b535e3de54`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:23.130816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-04931c12-1a5e-4a5d-9669-fedf64263d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:23.171581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:23.199289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1328/2658] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:23.210070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:23.211980 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:23.222647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:23.269303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e2df8-b29a-4ef0-9d9a-4c40cecd0bfc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:23.273193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608c962-863f-4a0a-83f0-d5178e0ac446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:23.273791 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c962-863f-4a0a-83f0-d5178e0ac446 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:23.274071 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c962-863f-4a0a-83f0-d5178e0ac446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:23.274342 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c962-863f-4a0a-83f0-d5178e0ac446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:23.284055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608c962-863f-4a0a-83f0-d5178e0ac446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:23.285497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608c962-863f-4a0a-83f0-d5178e0ac446 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:23.294685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1331/2659] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:23 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:23.440727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931c12-1a5e-4a5d-9669-fedf64263d20 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:23.503912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931c12-1a5e-4a5d-9669-fedf64263d20 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:23.508607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:23.510870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:23.510870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:23.510870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] PATH_INFO: `/v3/users/7ad4a17ac47745ff850cfc5ab9d85be4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:23.510870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad4a17ac47745ff850cfc5ab9d85be4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:23.512839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:23.696242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad4a17ac47745ff850cfc5ab9d85be4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:23.696926 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad4a17ac47745ff850cfc5ab9d85be4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:23.709102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad4a17ac47745ff850cfc5ab9d85be4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:23.715860 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad4a17ac47745ff850cfc5ab9d85be4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:23.716535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad4a17ac47745ff850cfc5ab9d85be4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:23.787047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1329/2660] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:39:23 2022] DELETE /identity/v3/users/7ad4a17ac47745ff850cfc5ab9d85be4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:23.791854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:23.792147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:23.792462 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:23.811428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:23.812665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:23.870345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1332/2661] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:23.880090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:23.881511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:23.938746 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed93d2-eb14-4d0a-8fc0-30dcbfd721fa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:23.943242 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:23.944035 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:23.944301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:23.944580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:23.953684 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:23.955100 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:23.960823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:23.965441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1330/2662] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:24.428491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:24.432654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:24.441914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5ce40-2ff7-4784-bd1f-1ab915f6941a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:24.447491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:24.448132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:24.448446 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:24.448722 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] PATH_INFO: `/v3/projects/601d1c08ca0843d48df89927b8f2f6ae` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:24.449852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=601d1c08ca0843d48df89927b8f2f6ae)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:24.451814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:24.571511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601d1c08ca0843d48df89927b8f2f6ae', 'request_id': 'req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.577234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601d1c08ca0843d48df89927b8f2f6ae', 'request_id': 'req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.655358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601d1c08ca0843d48df89927b8f2f6ae', 'request_id': 'req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.667203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] The token cache is being invalidate because project 601d1c08ca0843d48df89927b8f2f6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:39:24.667489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.669605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.669715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1333/2663] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:39:24 2022] DELETE /identity/v3/projects/601d1c08ca0843d48df89927b8f2f6ae => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:24.674187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:24.684899 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb80d-bf26-42db-9224-144df4df8ab8 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:24.742392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:24.743047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:24.743217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:24.743821 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] PATH_INFO: `/v3/users/105e942d95854dc1984275b535e3de54` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:24.744984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105e942d95854dc1984275b535e3de54)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:24.746902 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:24.929980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105e942d95854dc1984275b535e3de54'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.930645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105e942d95854dc1984275b535e3de54'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.942567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105e942d95854dc1984275b535e3de54'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.949795 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105e942d95854dc1984275b535e3de54'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:24.950458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a879b1e2-3909-4a44-af16-899bf1f09439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105e942d95854dc1984275b535e3de54'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:25.030013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1331/2664] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:39:24 2022] DELETE /identity/v3/users/105e942d95854dc1984275b535e3de54 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:25.439443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:25.440903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:25.454360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3aee8-0f71-47ea-9fef-7f1776cec1f2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:25.490238 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:25.513619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:25.514255 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:25.514536 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:25.514813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] PATH_INFO: `/v3/projects/0b0a0a0c0d6f43a3a0cee1e3a65f12d3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:25.515933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0a0a0c0d6f43a3a0cee1e3a65f12d3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:25.517911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:25.638050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0a0a0c0d6f43a3a0cee1e3a65f12d3', 'request_id': 'req-87f18b81-ee34-4050-9cfd-79063013cd98'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:25.643511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0a0a0c0d6f43a3a0cee1e3a65f12d3', 'request_id': 'req-87f18b81-ee34-4050-9cfd-79063013cd98'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:25.718035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0a0a0c0d6f43a3a0cee1e3a65f12d3', 'request_id': 'req-87f18b81-ee34-4050-9cfd-79063013cd98'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:25.730090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] The token cache is being invalidate because project 0b0a0a0c0d6f43a3a0cee1e3a65f12d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:39:25.730439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:25.731145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-87f18b81-ee34-4050-9cfd-79063013cd98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:25.732890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1334/2665] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:39:25 2022] DELETE /identity/v3/projects/0b0a0a0c0d6f43a3a0cee1e3a65f12d3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:25.737867 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be432-98e2-4394-9e7a-6f9bc1ba7451 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:25.738166 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be432-98e2-4394-9e7a-6f9bc1ba7451 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:25.738444 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be432-98e2-4394-9e7a-6f9bc1ba7451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:25.758385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ff3be432-98e2-4394-9e7a-6f9bc1ba7451 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:25.759604 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ff3be432-98e2-4394-9e7a-6f9bc1ba7451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:25.818596 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1332/2666] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:39:25.826271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0395-0b60-47fa-8668-c87e8482c719 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:25.826560 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0395-0b60-47fa-8668-c87e8482c719 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:25.826841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0395-0b60-47fa-8668-c87e8482c719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:25.846933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-266b0395-0b60-47fa-8668-c87e8482c719 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:25.848132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-266b0395-0b60-47fa-8668-c87e8482c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:25.856266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1335/2667] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:25.860537 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be432-98e2-4394-9e7a-6f9bc1ba7451 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:25.870474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be432-98e2-4394-9e7a-6f9bc1ba7451 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:25.875112 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:25.875710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:25.875993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:25.876304 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:25.876955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:39:25.877260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:25.878849 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:25.890982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1333/2668] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:39:25.895897 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0395-0b60-47fa-8668-c87e8482c719 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:25.905249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0395-0b60-47fa-8668-c87e8482c719 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:25.909912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:25.910503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:25.910785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:25.911282 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:25.911922 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:25.913872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:25.994248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1336/2669] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:39:25 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:25.998546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.009434 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b53c7-c378-4bb5-8e1a-256d7ebe1568 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.013348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:26.066585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.068239 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.068529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.068855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.069489 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.071416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.175285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1334/2670] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:39:25 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:26.179703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.193427 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cc4c4-3269-4631-a6e3-f3db3661fc9b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.198129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.198728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.199011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.199286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.200015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.201649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.212774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1337/2671] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:26.216796 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.227699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fb2e-173c-4471-ae11-96d5f03bd792 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.232423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f265e-147a-4a0d-8bda-3d34851b88ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.233025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f265e-147a-4a0d-8bda-3d34851b88ab admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.233314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f265e-147a-4a0d-8bda-3d34851b88ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.233593 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f265e-147a-4a0d-8bda-3d34851b88ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.234240 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f265e-147a-4a0d-8bda-3d34851b88ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.235839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f265e-147a-4a0d-8bda-3d34851b88ab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.247274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1335/2672] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:26.251551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.261542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ee95-ee09-4bc6-a00a-0b2c427b0532 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.266024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.266665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.266944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.267217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] PATH_INFO: `/v3/projects/a25f83ed4683444bab41edc4d89ff5bf/users/3e90bdf2a84443b2b7580036494f839e/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.282540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25f83ed4683444bab41edc4d89ff5bf, user_id=3e90bdf2a84443b2b7580036494f839e, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.285263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.370049 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1338/2673] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:26 2022] PUT /identity/v3/projects/a25f83ed4683444bab41edc4d89ff5bf/users/3e90bdf2a84443b2b7580036494f839e/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:26.382209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2bd15-7490-4bdc-a3a6-ee5cdee2d284 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.382497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2bd15-7490-4bdc-a3a6-ee5cdee2d284 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.382775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2bd15-7490-4bdc-a3a6-ee5cdee2d284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.412665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b2c2bd15-7490-4bdc-a3a6-ee5cdee2d284 None None] MFA Rules not processed for user `3e90bdf2a84443b2b7580036494f839e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:26.413893 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b2c2bd15-7490-4bdc-a3a6-ee5cdee2d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:26.477570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1336/2674] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:26.482167 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.543662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df3a66-8cc5-44fc-8ec6-98464ab0825d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.548335 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.548946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.549294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.549485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.550108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.552135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.557606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:26.674236 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1339/2675] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:39:26 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:26.678507 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2bd15-7490-4bdc-a3a6-ee5cdee2d284 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.689530 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2bd15-7490-4bdc-a3a6-ee5cdee2d284 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.747757 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.748324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.748617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.748896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.749544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.751511 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.813967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1337/2676] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:39:26 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:39:26.818973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.829209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15cc2-0b79-4749-af04-b625601e8198 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.834138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.834841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.835131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.835399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.836035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.837645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.847711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1340/2677] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:26.852531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.858858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:26.862624 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3ec59-b47c-4203-b390-312ca2242abc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:26.868080 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:26.869032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:26.869320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:26.873519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] PATH_INFO: `/v3/projects/64ff74e0fa014d53a6580eeafb2af510/users/fc62b106fb294bfb9406e46c60a00013/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:26.884856 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ff74e0fa014d53a6580eeafb2af510, user_id=fc62b106fb294bfb9406e46c60a00013, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:26.887510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:26.956154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1338/2678] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:26 2022] PUT /identity/v3/projects/64ff74e0fa014d53a6580eeafb2af510/users/fc62b106fb294bfb9406e46c60a00013/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:26.960774 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:26.971011 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4ad49-9ede-450f-8af7-79db7fa521cb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:27.027605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883edf7-7573-42b1-b336-583d39b68d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:27.028258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883edf7-7573-42b1-b336-583d39b68d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:27.028543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883edf7-7573-42b1-b336-583d39b68d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:27.028825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883edf7-7573-42b1-b336-583d39b68d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:27.029459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883edf7-7573-42b1-b336-583d39b68d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:27.031214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883edf7-7573-42b1-b336-583d39b68d03 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:27.041548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1341/2679] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:27.045750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:27.056287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87978c1-22f2-45dc-8f53-9bc849ec5182 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:27.060871 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:27.064583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:27.064583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:27.064583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] PATH_INFO: `/v3/projects/64ff74e0fa014d53a6580eeafb2af510/users/fc62b106fb294bfb9406e46c60a00013/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:27.064583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ff74e0fa014d53a6580eeafb2af510, user_id=fc62b106fb294bfb9406e46c60a00013, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:27.066615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:27.076642 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1339/2680] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:27 2022] PUT /identity/v3/projects/64ff74e0fa014d53a6580eeafb2af510/users/fc62b106fb294bfb9406e46c60a00013/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:27.087337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544463be-5259-4003-a433-c802889514e0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:27.087654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544463be-5259-4003-a433-c802889514e0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:27.087955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544463be-5259-4003-a433-c802889514e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:27.115996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-544463be-5259-4003-a433-c802889514e0 None None] MFA Rules not processed for user `fc62b106fb294bfb9406e46c60a00013`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:27.117227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-544463be-5259-4003-a433-c802889514e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:27.185137 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1342/2681] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:27.197027 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:27.203977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:27.258059 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d41e60-baa9-4fbc-8e7d-9b499caf82a2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:27.261680 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:27.262285 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:27.262567 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:27.262838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:27.272482 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:27.273908 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:27.283274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1340/2682] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:27.519232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544463be-5259-4003-a433-c802889514e0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:27.529649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544463be-5259-4003-a433-c802889514e0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:27.533231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73359d-3f3f-40e3-8d09-adbb8b8cd36c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:27.533831 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73359d-3f3f-40e3-8d09-adbb8b8cd36c service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:27.534113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73359d-3f3f-40e3-8d09-adbb8b8cd36c service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:27.534389 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73359d-3f3f-40e3-8d09-adbb8b8cd36c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:27.589051 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:27.591404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73359d-3f3f-40e3-8d09-adbb8b8cd36c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:27.592881 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73359d-3f3f-40e3-8d09-adbb8b8cd36c service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:27.601893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1343/2683] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:34.058193 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:34.119938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99884-4769-46f4-944a-3edcd8c5a75f service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:34.124442 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:34.125066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:34.125345 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:34.125618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] PATH_INFO: `/v3/users/3e90bdf2a84443b2b7580036494f839e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:34.126715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e90bdf2a84443b2b7580036494f839e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:34.128697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:34.280704 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e90bdf2a84443b2b7580036494f839e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:34.281501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e90bdf2a84443b2b7580036494f839e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:34.294381 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e90bdf2a84443b2b7580036494f839e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:34.299588 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:34.302340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e90bdf2a84443b2b7580036494f839e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:34.303011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e90bdf2a84443b2b7580036494f839e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:34.386436 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1341/2684] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:39:34 2022] DELETE /identity/v3/users/3e90bdf2a84443b2b7580036494f839e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:34.391147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:34.391651 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:34.391780 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:34.412088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:34.413322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:34.472552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1344/2685] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:34.483074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:34.484505 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:34.543379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f66b1-911a-4fa9-b657-00c6ac4a9c3c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:34.547111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:34.547665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:34.547958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:34.548261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:34.557697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:34.559120 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:34.568569 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1342/2686] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:35.045334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:35.046979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:35.074985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1cf0f-fdeb-4796-bf0c-e3d487645f5f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:35.081542 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:35.082444 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:35.082817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:35.083156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] PATH_INFO: `/v3/projects/a25f83ed4683444bab41edc4d89ff5bf` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:35.084715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25f83ed4683444bab41edc4d89ff5bf)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:35.088324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:35.174933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25f83ed4683444bab41edc4d89ff5bf', 'request_id': 'req-dbed389d-c66c-4ad4-9911-833898f74058'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.181297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25f83ed4683444bab41edc4d89ff5bf', 'request_id': 'req-dbed389d-c66c-4ad4-9911-833898f74058'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.247310 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25f83ed4683444bab41edc4d89ff5bf', 'request_id': 'req-dbed389d-c66c-4ad4-9911-833898f74058'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.259771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] The token cache is being invalidate because project a25f83ed4683444bab41edc4d89ff5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:39:35.260053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.260716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.262319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1345/2687] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:39:35 2022] DELETE /identity/v3/projects/a25f83ed4683444bab41edc4d89ff5bf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:35.266225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:35.277709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421466eb-4035-4ca6-b9bd-2a1e8986ba5b service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:35.339309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:35.339747 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:35.340034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:35.340361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] PATH_INFO: `/v3/users/fc62b106fb294bfb9406e46c60a00013` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:35.341506 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc62b106fb294bfb9406e46c60a00013)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:35.343420 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:35.543062 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc62b106fb294bfb9406e46c60a00013'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.543715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc62b106fb294bfb9406e46c60a00013'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.557168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc62b106fb294bfb9406e46c60a00013'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.565486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc62b106fb294bfb9406e46c60a00013'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.565826 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0d616d3d-0a16-43a6-96ee-530b004d639c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc62b106fb294bfb9406e46c60a00013'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:35.658723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1343/2688] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:39:35 2022] DELETE /identity/v3/users/fc62b106fb294bfb9406e46c60a00013 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:36.067966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:36.067966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:36.086653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed389d-c66c-4ad4-9911-833898f74058 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:36.143870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:36.144548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.149435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.149729 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] PATH_INFO: `/v3/projects/64ff74e0fa014d53a6580eeafb2af510` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.150905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ff74e0fa014d53a6580eeafb2af510)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:36.152867 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:36.177645 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:36.283483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ff74e0fa014d53a6580eeafb2af510', 'request_id': 'req-3077ec22-c989-4f27-bf45-062efa87f858'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:36.289400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ff74e0fa014d53a6580eeafb2af510', 'request_id': 'req-3077ec22-c989-4f27-bf45-062efa87f858'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:36.361259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ff74e0fa014d53a6580eeafb2af510', 'request_id': 'req-3077ec22-c989-4f27-bf45-062efa87f858'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:36.374042 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] The token cache is being invalidate because project 64ff74e0fa014d53a6580eeafb2af510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:39:36.374334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:36.374998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3077ec22-c989-4f27-bf45-062efa87f858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:39:36.376556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1346/2689] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:39:36 2022] DELETE /identity/v3/projects/64ff74e0fa014d53a6580eeafb2af510 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:36.382859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b887f-bc36-4328-a98b-ec7a66036579 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.382859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b887f-bc36-4328-a98b-ec7a66036579 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.382859 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b887f-bc36-4328-a98b-ec7a66036579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.402853 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-388b887f-bc36-4328-a98b-ec7a66036579 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:36.404058 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-388b887f-bc36-4328-a98b-ec7a66036579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:36.409484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:36.463415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1344/2690] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:36.471448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02f85-c579-445b-83ea-53c58d182f43 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.471763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02f85-c579-445b-83ea-53c58d182f43 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.472040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a02f85-c579-445b-83ea-53c58d182f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.491792 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-88a02f85-c579-445b-83ea-53c58d182f43 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:36.493356 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-88a02f85-c579-445b-83ea-53c58d182f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:36.501270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1347/2691] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:36.506260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b887f-bc36-4328-a98b-ec7a66036579 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:36.515991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b887f-bc36-4328-a98b-ec7a66036579 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:36.521087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:36.521842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.522123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.522396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.523039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:39:36.523340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:36.524984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:36.536464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1345/2692] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 11:39:36.540880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a02f85-c579-445b-83ea-53c58d182f43 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:36.550108 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a02f85-c579-445b-83ea-53c58d182f43 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:36.555289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:36.555886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.556163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.556463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.557083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:36.558954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:36.650682 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1348/2693] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:39:36 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:36.654657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:36.665236 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ec64-5c0d-46f3-9020-52fa84ab7835 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:36.724153 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:36.724791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.725076 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.725458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.726067 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:36.728033 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:36.808657 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1346/2694] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:39:36 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:36.812647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:36.824735 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7d9a-5376-4cc1-ad26-e476ce06b168 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:36.830834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:36.831439 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.831728 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.831999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.832688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:36.834434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:36.845485 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1349/2695] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:36.849371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:36.859638 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f852998-ba12-4c7d-bda9-f6ffe050a0c8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:36.865308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dda8f-0f9e-483b-bf2a-300badbba5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:36.870692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dda8f-0f9e-483b-bf2a-300badbba5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.870692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dda8f-0f9e-483b-bf2a-300badbba5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.870692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dda8f-0f9e-483b-bf2a-300badbba5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.870692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dda8f-0f9e-483b-bf2a-300badbba5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:36.870692 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dda8f-0f9e-483b-bf2a-300badbba5e1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:36.880702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1347/2696] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:36.885143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:36.896095 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b258109-ec04-41ba-8007-31cdd50ca81a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:36.901024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:36.901620 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:36.901905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:36.902182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] PATH_INFO: `/v3/projects/497244c19f0c4aeab7dea5d49daebdf7/users/6bf9e4c3744840d09d651666cf1e7a70/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:36.918184 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=497244c19f0c4aeab7dea5d49daebdf7, user_id=6bf9e4c3744840d09d651666cf1e7a70, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:36.922367 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:37.003945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1350/2697] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:36 2022] PUT /identity/v3/projects/497244c19f0c4aeab7dea5d49daebdf7/users/6bf9e4c3744840d09d651666cf1e7a70/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:37.009330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecf49a-4bbf-455c-81c4-62277d013890 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:37.009620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecf49a-4bbf-455c-81c4-62277d013890 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:37.010018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecf49a-4bbf-455c-81c4-62277d013890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:37.029131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-45ecf49a-4bbf-455c-81c4-62277d013890 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:37.030330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-45ecf49a-4bbf-455c-81c4-62277d013890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:37.089070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1348/2698] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:37.099302 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:37.101091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:37.157281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bff35-61fc-4bcd-8a71-20b14e371f3d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:37.161383 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:37.161981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:37.162260 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:37.162531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:37.171672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:37.173187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:37.182874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1351/2699] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:38.405838 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a995-f3df-4542-b71d-04c9357450b7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:38.406382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a995-f3df-4542-b71d-04c9357450b7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:38.406382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a995-f3df-4542-b71d-04c9357450b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:38.437328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0c03a995-f3df-4542-b71d-04c9357450b7 None None] MFA Rules not processed for user `6bf9e4c3744840d09d651666cf1e7a70`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:38.438558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0c03a995-f3df-4542-b71d-04c9357450b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:38.443803 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:38.504782 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1349/2700] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:38.509263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:38.520411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fda6da-2531-4f3e-afc7-57672751b28f service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:38.525512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:38.526135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:38.526538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:38.526754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:38.527406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:38.529361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:38.593363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1352/2701] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:39:38 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:38.597480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a995-f3df-4542-b71d-04c9357450b7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:38.609387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03a995-f3df-4542-b71d-04c9357450b7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:38.665982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:38.666608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:38.667089 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:38.667925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:38.668643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:38.670577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:38.745532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1350/2702] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:39:38 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:39:38.749475 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:38.760428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e9d76-7e8f-4270-8551-9b44218a8129 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:38.764861 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:38.765527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:38.765808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:38.766079 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:38.766711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:38.768324 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:38.779321 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1353/2703] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:38.783622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:38.797846 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f00a8f-f9ec-4795-b05d-ae4417be1642 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:38.799009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:38.799678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:38.799964 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:38.800281 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] PATH_INFO: `/v3/projects/6f370584f65d406090b48df4e7b66baa/users/89b1c67b6ec748a38675c442588e0991/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:38.816134 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f370584f65d406090b48df4e7b66baa, user_id=89b1c67b6ec748a38675c442588e0991, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:38.819158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:38.888764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1351/2704] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:38 2022] PUT /identity/v3/projects/6f370584f65d406090b48df4e7b66baa/users/89b1c67b6ec748a38675c442588e0991/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:39:38.892788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:38.903956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e6c3b-194e-44b1-be0d-1beb304fbfae admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:38.916337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:38.962872 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f0372-3c8b-406f-9f53-5346a9f40b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:38.963740 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0372-3c8b-406f-9f53-5346a9f40b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:38.964480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0372-3c8b-406f-9f53-5346a9f40b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:38.964751 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0372-3c8b-406f-9f53-5346a9f40b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:38.965505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f0372-3c8b-406f-9f53-5346a9f40b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:38.967124 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f0372-3c8b-406f-9f53-5346a9f40b0b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:38.981235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1354/2705] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:39:38.982409 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:38.993510 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31948-8d2a-478c-8e75-5f715194ee90 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:38.998265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7295e30-d922-40a4-9a5b-3b42eded4a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:38.998922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7295e30-d922-40a4-9a5b-3b42eded4a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:38.999205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7295e30-d922-40a4-9a5b-3b42eded4a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:38.999488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7295e30-d922-40a4-9a5b-3b42eded4a26 admin admin] PATH_INFO: `/v3/projects/6f370584f65d406090b48df4e7b66baa/users/89b1c67b6ec748a38675c442588e0991/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:39.001421 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7295e30-d922-40a4-9a5b-3b42eded4a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f370584f65d406090b48df4e7b66baa, user_id=89b1c67b6ec748a38675c442588e0991, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:39.004138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7295e30-d922-40a4-9a5b-3b42eded4a26 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:39.014793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1352/2706] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:39:38 2022] PUT /identity/v3/projects/6f370584f65d406090b48df4e7b66baa/users/89b1c67b6ec748a38675c442588e0991/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:39:40.386977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:40.388104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:40.388574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:40.421187 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] MFA Rules not processed for user `89b1c67b6ec748a38675c442588e0991`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:40.423040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:40.508092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1355/2707] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:40.520513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3bc5-bdc9-4933-aa03-a7697dbf206f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:40.521045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3bc5-bdc9-4933-aa03-a7697dbf206f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:40.521297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c3bc5-bdc9-4933-aa03-a7697dbf206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:40.541325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-161c3bc5-bdc9-4933-aa03-a7697dbf206f None None] MFA Rules not processed for user `6bf9e4c3744840d09d651666cf1e7a70`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:40.542645 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-161c3bc5-bdc9-4933-aa03-a7697dbf206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:40.604075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1353/2708] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:40.619194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:40.620668 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:40.695541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f14ee-7e08-4a17-bd07-ded1114b4354 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:40.701101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:40.701852 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:40.702132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:40.702406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:40.711695 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:40.713311 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:40.722482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1356/2709] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:41.332845 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:41.333146 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:41.333641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:41.343984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:41.356245 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] MFA Rules not processed for user `a580c24eab0a41ceb5dbca37af5e0b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:39:41.357682 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:41.419498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1354/2710] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:39:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:39:44.587348 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:44.588910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:44.617165 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:44.653370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e15ce8-5351-496a-b570-4459c473f7c3 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:44.656944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:44.657549 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:44.657827 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:44.658101 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:44.659848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:44.670122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:44.671667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:44.680169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1357/2711] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:39:51.437707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=23 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:54.676910 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=16 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:59.039730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:39:59.039730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:39:59.039730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bea63-ce30-49b2-846f-b7c1d0712956 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:39:59.041840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:39:59.041840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:39:59.041840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:39:59.041840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:39:59.042210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:39:59.042210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:39:59.042210 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1355/2712] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:39:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:00.867481 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:00.869020 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:00.885052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e092a10-c8fd-4d2a-b490-3c1182fc3491 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:00.890482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:00.891262 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:00.891540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:00.891812 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:00.894015 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:00.906592 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:00.908158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:00.919638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1358/2713] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:08.951705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=26 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:10.915198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:22.458244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:22.523102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfa919-1d1e-4120-9226-1cc717b0084b service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:22.527705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:22.528325 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:22.528606 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:22.528881 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] PATH_INFO: `/v3/users/6bf9e4c3744840d09d651666cf1e7a70` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:22.529994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf9e4c3744840d09d651666cf1e7a70)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:22.531921 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:22.689941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf9e4c3744840d09d651666cf1e7a70'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:22.690715 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf9e4c3744840d09d651666cf1e7a70'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:22.702396 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf9e4c3744840d09d651666cf1e7a70'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:22.711799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf9e4c3744840d09d651666cf1e7a70'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:22.712462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf9e4c3744840d09d651666cf1e7a70'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:22.808187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1356/2714] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:40:22 2022] DELETE /identity/v3/users/6bf9e4c3744840d09d651666cf1e7a70 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:23.072958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:23.083857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb18456-b417-4925-8d7b-dfbf3b56e2bb service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:23.143048 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:23.143687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:23.143970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:23.144279 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] PATH_INFO: `/v3/projects/497244c19f0c4aeab7dea5d49daebdf7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:23.145399 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=497244c19f0c4aeab7dea5d49daebdf7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:23.147289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:23.265371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497244c19f0c4aeab7dea5d49daebdf7', 'request_id': 'req-126242ab-1d13-4458-b3e0-497d5b23c899'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.271865 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497244c19f0c4aeab7dea5d49daebdf7', 'request_id': 'req-126242ab-1d13-4458-b3e0-497d5b23c899'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.348402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497244c19f0c4aeab7dea5d49daebdf7', 'request_id': 'req-126242ab-1d13-4458-b3e0-497d5b23c899'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.360632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] The token cache is being invalidate because project 497244c19f0c4aeab7dea5d49daebdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:40:23.360941 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.362127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.363660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1359/2715] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:40:23 2022] DELETE /identity/v3/projects/497244c19f0c4aeab7dea5d49daebdf7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:23.367886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:23.369400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:23.383515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9355f-7e5a-44b0-ad9e-3b3fcecf0e0c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:23.442655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:23.443353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:23.443643 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:23.443940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] PATH_INFO: `/v3/users/89b1c67b6ec748a38675c442588e0991` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:23.445179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b1c67b6ec748a38675c442588e0991)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:23.447133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:23.469303 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:23.630191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b1c67b6ec748a38675c442588e0991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.630897 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b1c67b6ec748a38675c442588e0991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.643419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b1c67b6ec748a38675c442588e0991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.650357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b1c67b6ec748a38675c442588e0991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.651003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-aea7b32a-0dad-41a7-bdfa-954088fd9147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b1c67b6ec748a38675c442588e0991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:23.727852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1357/2716] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:40:23 2022] DELETE /identity/v3/users/89b1c67b6ec748a38675c442588e0991 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:23.980892 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:23.982362 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:23.997080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126242ab-1d13-4458-b3e0-497d5b23c899 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:24.056190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:24.056873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.057156 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.057434 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] PATH_INFO: `/v3/projects/6f370584f65d406090b48df4e7b66baa` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.058578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f370584f65d406090b48df4e7b66baa)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:24.060538 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:24.154251 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:24.166514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f370584f65d406090b48df4e7b66baa', 'request_id': 'req-1389f860-6f53-4afe-bf8f-fb0835ef34e3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:24.171675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f370584f65d406090b48df4e7b66baa', 'request_id': 'req-1389f860-6f53-4afe-bf8f-fb0835ef34e3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:24.257209 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f370584f65d406090b48df4e7b66baa', 'request_id': 'req-1389f860-6f53-4afe-bf8f-fb0835ef34e3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:24.269245 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] The token cache is being invalidate because project 6f370584f65d406090b48df4e7b66baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:40:24.269543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:24.270160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1389f860-6f53-4afe-bf8f-fb0835ef34e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:24.271688 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1360/2717] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:40:23 2022] DELETE /identity/v3/projects/6f370584f65d406090b48df4e7b66baa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:24.276712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564a69-3ba9-4ee4-8ea3-ce5b699fa944 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.277030 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564a69-3ba9-4ee4-8ea3-ce5b699fa944 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.277313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564a69-3ba9-4ee4-8ea3-ce5b699fa944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.297167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-41564a69-3ba9-4ee4-8ea3-ce5b699fa944 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:24.303971 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-41564a69-3ba9-4ee4-8ea3-ce5b699fa944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:24.357730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1358/2718] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:24.365923 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291220d7-aa1a-42b8-bb46-c0646b1b7143 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.366215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291220d7-aa1a-42b8-bb46-c0646b1b7143 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.366800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291220d7-aa1a-42b8-bb46-c0646b1b7143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.386957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-291220d7-aa1a-42b8-bb46-c0646b1b7143 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:24.388158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-291220d7-aa1a-42b8-bb46-c0646b1b7143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:24.396709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1361/2719] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:24.400815 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41564a69-3ba9-4ee4-8ea3-ce5b699fa944 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:24.410529 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41564a69-3ba9-4ee4-8ea3-ce5b699fa944 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:24.415070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:24.415663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.415943 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.416235 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.416888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:40:24.417189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:24.418781 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:24.430374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1359/2720] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:40:24.434525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291220d7-aa1a-42b8-bb46-c0646b1b7143 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:24.444672 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291220d7-aa1a-42b8-bb46-c0646b1b7143 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:24.449372 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:24.449964 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.450248 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.450526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.451189 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:24.453121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:24.552975 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1362/2721] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:40:24 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:40:24.557071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:24.569654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad198dc-0779-468b-8c55-59a597a8dab6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:24.629557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:24.630167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.630446 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.630720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.631344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:24.633391 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:24.725664 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1360/2722] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:40:24 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:40:24.729755 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:24.740911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe3f9a-5d6b-4580-a114-ad38d96ec91e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:24.746055 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:24.746681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.746959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.747232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.747870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:24.749545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:24.759948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1363/2723] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:40:24.763929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:24.773979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974ac7a-0240-49d6-8fac-414575142dc4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:24.778577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063a6c2-b877-416c-8897-ac206fd7ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:24.779173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063a6c2-b877-416c-8897-ac206fd7ba42 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.779455 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063a6c2-b877-416c-8897-ac206fd7ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.779730 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063a6c2-b877-416c-8897-ac206fd7ba42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.780415 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063a6c2-b877-416c-8897-ac206fd7ba42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:24.782032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063a6c2-b877-416c-8897-ac206fd7ba42 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:24.792383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1361/2724] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:40:24.796548 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:24.806817 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64fee-bdc6-4ac9-9d5b-73fbd0055221 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:24.811293 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:24.811938 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.812203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.812506 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] PATH_INFO: `/v3/projects/6ed9b5299a454e6da60336b01d06784b/users/93dd150152f746c49e104a2fbee0a7b6/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.827143 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed9b5299a454e6da60336b01d06784b, user_id=93dd150152f746c49e104a2fbee0a7b6, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:24.829794 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:24.928771 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1364/2725] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:40:24 2022] PUT /identity/v3/projects/6ed9b5299a454e6da60336b01d06784b/users/93dd150152f746c49e104a2fbee0a7b6/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:24.940257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100a4ed-35d9-47d2-8ac6-d46acb1a1f29 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:24.940552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100a4ed-35d9-47d2-8ac6-d46acb1a1f29 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:24.940829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100a4ed-35d9-47d2-8ac6-d46acb1a1f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:24.949047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:24.968362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e100a4ed-35d9-47d2-8ac6-d46acb1a1f29 None None] MFA Rules not processed for user `93dd150152f746c49e104a2fbee0a7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:24.969574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e100a4ed-35d9-47d2-8ac6-d46acb1a1f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:25.034419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1362/2726] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:40:25.045816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:25.047498 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:25.104879 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a2ec-b3bd-403b-9560-0194be613432 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:25.108428 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7eb10-246b-4cf0-890f-06e1cde3fccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:25.109032 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7eb10-246b-4cf0-890f-06e1cde3fccc service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:25.109314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7eb10-246b-4cf0-890f-06e1cde3fccc service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:25.109589 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7eb10-246b-4cf0-890f-06e1cde3fccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:25.118539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7eb10-246b-4cf0-890f-06e1cde3fccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:25.119981 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7eb10-246b-4cf0-890f-06e1cde3fccc service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:25.128691 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1365/2727] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:35.042161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=30 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:35.124611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:43.109270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100a4ed-35d9-47d2-8ac6-d46acb1a1f29 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:43.171958 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100a4ed-35d9-47d2-8ac6-d46acb1a1f29 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:43.177201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:43.177828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:43.178108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:43.178383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] PATH_INFO: `/v3/users/93dd150152f746c49e104a2fbee0a7b6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:43.179488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dd150152f746c49e104a2fbee0a7b6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:43.181448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:43.336327 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dd150152f746c49e104a2fbee0a7b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:43.336998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dd150152f746c49e104a2fbee0a7b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:43.349634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dd150152f746c49e104a2fbee0a7b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:43.356708 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dd150152f746c49e104a2fbee0a7b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:43.357293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dd150152f746c49e104a2fbee0a7b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:43.427707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1363/2728] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:40:43 2022] DELETE /identity/v3/users/93dd150152f746c49e104a2fbee0a7b6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:43.432387 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:43.432874 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:43.432982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:43.451586 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:43.454456 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:43.511540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1366/2729] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:40:43.522238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:43.523676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:43.581177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496940f3-b2b4-4082-8184-0072f681ae95 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:43.584857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808bf50-1591-4089-8e33-6a314d34199a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:43.585468 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808bf50-1591-4089-8e33-6a314d34199a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:43.585750 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808bf50-1591-4089-8e33-6a314d34199a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:43.586025 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808bf50-1591-4089-8e33-6a314d34199a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:43.595257 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808bf50-1591-4089-8e33-6a314d34199a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:43.596707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808bf50-1591-4089-8e33-6a314d34199a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:43.606045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1364/2730] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:43.997334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:43.998745 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:44.011013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf652a3-8b5b-4013-b06e-08a9a12edef6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.015850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.017535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.017535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.017535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] PATH_INFO: `/v3/projects/6ed9b5299a454e6da60336b01d06784b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.019146 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed9b5299a454e6da60336b01d06784b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.021178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.115430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed9b5299a454e6da60336b01d06784b', 'request_id': 'req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:44.121064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed9b5299a454e6da60336b01d06784b', 'request_id': 'req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:44.175832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed9b5299a454e6da60336b01d06784b', 'request_id': 'req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:44.187091 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] The token cache is being invalidate because project 6ed9b5299a454e6da60336b01d06784b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:40:44.187382 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:44.188013 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9b3b7f8b-4b23-4e9f-9393-4967cb287eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:44.189718 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1367/2731] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:40:43 2022] DELETE /identity/v3/projects/6ed9b5299a454e6da60336b01d06784b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:44.194756 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c58b4-1ff3-4715-b4dc-73fd34fd382c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.195214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c58b4-1ff3-4715-b4dc-73fd34fd382c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.195333 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c58b4-1ff3-4715-b4dc-73fd34fd382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.215238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e29c58b4-1ff3-4715-b4dc-73fd34fd382c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:44.216481 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e29c58b4-1ff3-4715-b4dc-73fd34fd382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:44.233581 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:44.275154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1365/2732] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:44.283634 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42218be-5969-4d91-a588-0283a1ecf10f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.283927 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42218be-5969-4d91-a588-0283a1ecf10f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.284204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42218be-5969-4d91-a588-0283a1ecf10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.303674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b42218be-5969-4d91-a588-0283a1ecf10f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:44.304906 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b42218be-5969-4d91-a588-0283a1ecf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:44.312809 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1368/2733] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:44.317005 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c58b4-1ff3-4715-b4dc-73fd34fd382c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:44.326475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c58b4-1ff3-4715-b4dc-73fd34fd382c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.331519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.332118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.332474 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.332713 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.333416 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:40:44.333721 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.335309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.347266 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1366/2734] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:40:44.351373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42218be-5969-4d91-a588-0283a1ecf10f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:44.361093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42218be-5969-4d91-a588-0283a1ecf10f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.366058 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.366619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.366903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.367200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.367840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.369786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.448046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1369/2735] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:40:44 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:40:44.452349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:44.462825 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76273f81-2f88-43ec-9542-d6f8091bdddf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.520463 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.521104 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.521390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.521665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.522296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.524228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.601808 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1367/2736] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:40:44 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:40:44.605860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:44.616801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888df459-5b7f-4cb4-a8ea-f8af3c9df9b4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.621328 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.621932 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.622200 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.622476 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.623159 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.624778 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.635256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1370/2737] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:40:44.639243 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:44.650214 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c0b36-3341-48d2-b65d-85b7cdf0aeb8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.654844 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351787-4e0f-4b69-a4ce-de1cdedf487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.655433 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351787-4e0f-4b69-a4ce-de1cdedf487c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.655712 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351787-4e0f-4b69-a4ce-de1cdedf487c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.655987 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351787-4e0f-4b69-a4ce-de1cdedf487c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.656660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351787-4e0f-4b69-a4ce-de1cdedf487c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.658649 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351787-4e0f-4b69-a4ce-de1cdedf487c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.669197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1368/2738] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:40:44.673707 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:44.683489 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615de1c8-b1a0-4bc4-acb2-fce13f62a4b8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.688606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e025-c810-4a67-b817-28124588849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.689582 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e025-c810-4a67-b817-28124588849e admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.689859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e025-c810-4a67-b817-28124588849e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.690130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e025-c810-4a67-b817-28124588849e admin admin] PATH_INFO: `/v3/projects/e19e119bdf8e48c6a669c4d56a1861e7/users/70e5f41f225d4e6c9a59d95239ef2aa7/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.706569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910e025-c810-4a67-b817-28124588849e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19e119bdf8e48c6a669c4d56a1861e7, user_id=70e5f41f225d4e6c9a59d95239ef2aa7, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.709226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910e025-c810-4a67-b817-28124588849e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.795887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1371/2739] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:40:44 2022] PUT /identity/v3/projects/e19e119bdf8e48c6a669c4d56a1861e7/users/70e5f41f225d4e6c9a59d95239ef2aa7/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:44.807271 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457be88-ea60-40fa-9536-4fffa829ee1b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.807555 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457be88-ea60-40fa-9536-4fffa829ee1b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.807828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457be88-ea60-40fa-9536-4fffa829ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.834904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2457be88-ea60-40fa-9536-4fffa829ee1b None None] MFA Rules not processed for user `70e5f41f225d4e6c9a59d95239ef2aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:44.836090 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2457be88-ea60-40fa-9536-4fffa829ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:44.899842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1369/2740] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:44.910531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e025-c810-4a67-b817-28124588849e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:44.912198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e910e025-c810-4a67-b817-28124588849e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:44.933956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:44.970259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e025-c810-4a67-b817-28124588849e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:44.974386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44701310-aa9d-48d0-aec0-372fca3ebbd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:44.974995 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44701310-aa9d-48d0-aec0-372fca3ebbd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:44.975280 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44701310-aa9d-48d0-aec0-372fca3ebbd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:44.975556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44701310-aa9d-48d0-aec0-372fca3ebbd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:44.983723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44701310-aa9d-48d0-aec0-372fca3ebbd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:44.985783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44701310-aa9d-48d0-aec0-372fca3ebbd1 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:44.994725 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1372/2741] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:49.044698 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457be88-ea60-40fa-9536-4fffa829ee1b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:49.066575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:49.112877 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457be88-ea60-40fa-9536-4fffa829ee1b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:49.117627 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:49.118262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:49.118584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:49.118889 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] PATH_INFO: `/v3/users/70e5f41f225d4e6c9a59d95239ef2aa7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:49.120479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e5f41f225d4e6c9a59d95239ef2aa7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:49.122359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:49.350186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e5f41f225d4e6c9a59d95239ef2aa7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:49.350854 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e5f41f225d4e6c9a59d95239ef2aa7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:49.362727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e5f41f225d4e6c9a59d95239ef2aa7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:49.370053 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e5f41f225d4e6c9a59d95239ef2aa7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:49.370660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e5f41f225d4e6c9a59d95239ef2aa7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:49.439131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1370/2742] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:40:49 2022] DELETE /identity/v3/users/70e5f41f225d4e6c9a59d95239ef2aa7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:49.443667 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:49.444170 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:49.444339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:49.463675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:49.464889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:49.525544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1373/2743] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:49.536382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:49.539119 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:49.600151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54416905-200e-491e-825a-5b12b2432fa8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:49.603894 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee0d89-c0e1-44e4-9c21-42a042361d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:49.604539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee0d89-c0e1-44e4-9c21-42a042361d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:49.604824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee0d89-c0e1-44e4-9c21-42a042361d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:49.605129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee0d89-c0e1-44e4-9c21-42a042361d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:49.614912 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee0d89-c0e1-44e4-9c21-42a042361d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:49.616695 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee0d89-c0e1-44e4-9c21-42a042361d67 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:49.630445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1371/2744] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:50.060150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:50.061614 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:50.075088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b924c-b8e3-4259-b1bb-1ead602c376b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:50.080407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:50.081183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.081562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.081937 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] PATH_INFO: `/v3/projects/e19e119bdf8e48c6a669c4d56a1861e7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.084030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19e119bdf8e48c6a669c4d56a1861e7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:50.086062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:50.210821 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19e119bdf8e48c6a669c4d56a1861e7', 'request_id': 'req-f2c67663-68a5-408f-a297-11424dfd4416'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:50.216638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19e119bdf8e48c6a669c4d56a1861e7', 'request_id': 'req-f2c67663-68a5-408f-a297-11424dfd4416'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:50.314161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19e119bdf8e48c6a669c4d56a1861e7', 'request_id': 'req-f2c67663-68a5-408f-a297-11424dfd4416'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:50.325712 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] The token cache is being invalidate because project e19e119bdf8e48c6a669c4d56a1861e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:40:50.326000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:50.326619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f2c67663-68a5-408f-a297-11424dfd4416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:40:50.328073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1374/2745] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:40:50 2022] DELETE /identity/v3/projects/e19e119bdf8e48c6a669c4d56a1861e7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:40:50.333952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e81062-8ed0-44f2-83ac-66c606735e83 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.334497 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e81062-8ed0-44f2-83ac-66c606735e83 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.334798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e81062-8ed0-44f2-83ac-66c606735e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.355707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d2e81062-8ed0-44f2-83ac-66c606735e83 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:50.356941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d2e81062-8ed0-44f2-83ac-66c606735e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:50.390852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:50.416547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1372/2746] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:50.480290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746df7ed-c773-4d33-a6b3-86f0b893b825 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.480834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746df7ed-c773-4d33-a6b3-86f0b893b825 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.480834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746df7ed-c773-4d33-a6b3-86f0b893b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.501482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-746df7ed-c773-4d33-a6b3-86f0b893b825 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:50.502687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-746df7ed-c773-4d33-a6b3-86f0b893b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:50.510565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1375/2747] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:40:50.514738 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e81062-8ed0-44f2-83ac-66c606735e83 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:50.524602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e81062-8ed0-44f2-83ac-66c606735e83 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:50.529225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:50.529842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.530123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.530397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.531047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:40:50.531352 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:50.533691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:50.545206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1373/2748] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:40:50.550531 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746df7ed-c773-4d33-a6b3-86f0b893b825 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:50.559848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746df7ed-c773-4d33-a6b3-86f0b893b825 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:50.564901 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:50.565569 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.565819 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.566089 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.566727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:50.568708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:50.643057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1376/2749] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:40:50 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:40:50.647532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:50.658368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b61f-4a96-408f-bcc4-82667fa92ada admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:50.713560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:50.714173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.714458 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.714737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.715375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:50.717324 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:50.801950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1374/2750] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:40:50 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:40:50.806043 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:50.816358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e197e5-6bea-45f7-b05b-0f35c83bb9aa admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:50.821249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:50.821848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.822131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.822468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.823050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:50.824679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:50.835358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1377/2751] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:40:50.839218 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:50.850419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc610c97-011f-494e-ab20-2497561bdc95 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:50.855063 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ddebd-8fb7-4b6d-bc4a-be9fa6bafdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:50.855660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ddebd-8fb7-4b6d-bc4a-be9fa6bafdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.855940 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ddebd-8fb7-4b6d-bc4a-be9fa6bafdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.856228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ddebd-8fb7-4b6d-bc4a-be9fa6bafdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.856906 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ddebd-8fb7-4b6d-bc4a-be9fa6bafdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:50.858491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ddebd-8fb7-4b6d-bc4a-be9fa6bafdc9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:50.869126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1375/2752] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:40:50.873204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:50.883721 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27a4ef-0c9b-4b39-89fb-c19c52630f16 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:50.888479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:50.889139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.889422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.889697 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] PATH_INFO: `/v3/projects/09b4d12d43344204a5227e438a924c00/users/fda4f16ddc9d4eac836538122197e81c/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:50.892670 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:50.906093 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b4d12d43344204a5227e438a924c00, user_id=fda4f16ddc9d4eac836538122197e81c, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:50.909666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:50.978234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1378/2753] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:40:50 2022] PUT /identity/v3/projects/09b4d12d43344204a5227e438a924c00/users/fda4f16ddc9d4eac836538122197e81c/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:40:50.992547 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd639-551b-458f-86b3-5d3335612578 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:50.992840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd639-551b-458f-86b3-5d3335612578 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:50.993141 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdd639-551b-458f-86b3-5d3335612578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:51.021159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c9bdd639-551b-458f-86b3-5d3335612578 None None] MFA Rules not processed for user `fda4f16ddc9d4eac836538122197e81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:51.022371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c9bdd639-551b-458f-86b3-5d3335612578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:51.086301 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1376/2754] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:51.097465 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:51.099210 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:51.155770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937bfaa-96fa-4247-b67d-3beffc1c9980 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:51.160276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:51.160884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:51.161160 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:51.161430 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:51.169466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:51.170873 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:51.180021 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1379/2755] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:52.855636 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:52.856139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:52.856287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:52.875173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] MFA Rules not processed for user `fda4f16ddc9d4eac836538122197e81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:40:52.877075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:52.883938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1377/2756] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:40:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:40:53.426884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:53.428294 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:53.503942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b2730-2bbe-43a8-a000-25350c662395 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:53.509056 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:53.509666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:53.509948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:53.510220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:53.511994 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:53.524468 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:53.526127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:53.537232 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1380/2757] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:57.606326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:40:57.607923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:57.644244 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:57.688489 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2a94e-c8f6-47b4-a3c7-437314d6e21a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:40:57.695016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14d7ef-5e5f-4564-bd29-27318d0ce7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:40:57.696691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d7ef-5e5f-4564-bd29-27318d0ce7c4 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:40:57.696691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d7ef-5e5f-4564-bd29-27318d0ce7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:40:57.696691 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14d7ef-5e5f-4564-bd29-27318d0ce7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:40:57.698478 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ed14d7ef-5e5f-4564-bd29-27318d0ce7c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:40:57.714448 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14d7ef-5e5f-4564-bd29-27318d0ce7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:40:57.716074 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14d7ef-5e5f-4564-bd29-27318d0ce7c4 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:40:57.728408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1378/2758] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:40:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:41:02.986277 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:02.998814 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6115-7ca5-4c09-95ab-91ea488facf7 service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:03.005271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:03.005862 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:03.006141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:03.006413 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:03.008391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:03.020608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:03.022155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:03.032787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1381/2759] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:41:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:41:07.744009 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=21 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:10.311585 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d6410-9baf-4d9b-9b16-ad6e6829e81c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:10.312156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d6410-9baf-4d9b-9b16-ad6e6829e81c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:10.312156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d6410-9baf-4d9b-9b16-ad6e6829e81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:10.362201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fa4d6410-9baf-4d9b-9b16-ad6e6829e81c None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:41:10.363397 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fa4d6410-9baf-4d9b-9b16-ad6e6829e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:10.426764 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1379/2760] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:41:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:41:10.550391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:10.550391 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:10.612322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:10.638962 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391f634-f9f3-4ab0-9994-e684ef89bde8 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:10.644658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:10.645267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:10.645552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:10.645829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:10.654270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:10.656447 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:10.664544 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1382/2761] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:41:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:11.436761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243d0b-d224-4f7d-a12a-4c97005907a7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:11.437238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243d0b-d224-4f7d-a12a-4c97005907a7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:11.437690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243d0b-d224-4f7d-a12a-4c97005907a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:11.456609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ae243d0b-d224-4f7d-a12a-4c97005907a7 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:41:11.457839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ae243d0b-d224-4f7d-a12a-4c97005907a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:11.464955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1380/2762] 10.222.0.86 () {58 vars in 967 bytes} [Thu Aug 18 11:41:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:41:11.477626 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:11.488843 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130dd13-ad1f-440c-a74a-c9bb18449066 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:11.494154 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:11.494749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:11.495035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:11.495312 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:11.503292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:11.504918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:11.512935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1383/2763] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:12.098160 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d40377-4f2b-4f03-ba24-d1fe2d2db9ed None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:12.098453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d40377-4f2b-4f03-ba24-d1fe2d2db9ed None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:12.098729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d40377-4f2b-4f03-ba24-d1fe2d2db9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:12.119269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-47d40377-4f2b-4f03-ba24-d1fe2d2db9ed None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:41:12.120502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-47d40377-4f2b-4f03-ba24-d1fe2d2db9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:12.127719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1381/2764] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:41:12.139354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:12.150486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a0867-e4f5-49bc-8f16-020700f47d35 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:12.155379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:12.156786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:12.157069 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:12.157343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:12.165303 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:12.167005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:12.175289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1384/2765] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:12.785181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1f745-8a5d-4d3c-baa2-7e7e0578ef57 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:12.785678 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1f745-8a5d-4d3c-baa2-7e7e0578ef57 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:12.785790 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1f745-8a5d-4d3c-baa2-7e7e0578ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:12.804828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-79b1f745-8a5d-4d3c-baa2-7e7e0578ef57 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:41:12.806018 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-79b1f745-8a5d-4d3c-baa2-7e7e0578ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:12.813641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1382/2766] 10.222.0.86 () {58 vars in 967 bytes} [Thu Aug 18 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:41:12.825709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:12.837832 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dfe10-42b8-4f3f-9380-174d0259a49b service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:12.842869 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9730fd-9123-4eb7-8cba-ebff9bd8d64d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:12.843473 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9730fd-9123-4eb7-8cba-ebff9bd8d64d service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:12.843767 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9730fd-9123-4eb7-8cba-ebff9bd8d64d service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:12.844027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9730fd-9123-4eb7-8cba-ebff9bd8d64d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:12.852590 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9730fd-9123-4eb7-8cba-ebff9bd8d64d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:12.854204 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9730fd-9123-4eb7-8cba-ebff9bd8d64d service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:12.862982 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1385/2767] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 11:41:15.449659 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1f745-8a5d-4d3c-baa2-7e7e0578ef57 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:15.512087 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1f745-8a5d-4d3c-baa2-7e7e0578ef57 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:15.517583 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:15.518207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:15.518600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:15.518879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] PATH_INFO: `/v3/users/fda4f16ddc9d4eac836538122197e81c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:15.520075 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda4f16ddc9d4eac836538122197e81c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:15.522023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:15.654013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda4f16ddc9d4eac836538122197e81c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:15.654655 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda4f16ddc9d4eac836538122197e81c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:15.660319 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:15.667138 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda4f16ddc9d4eac836538122197e81c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:15.674850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda4f16ddc9d4eac836538122197e81c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:15.675539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda4f16ddc9d4eac836538122197e81c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:15.725600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1383/2768] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:41:15 2022] DELETE /identity/v3/users/fda4f16ddc9d4eac836538122197e81c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:41:15.729972 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:15.730511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:15.730511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:15.751591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:41:15.752811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:15.810829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1386/2769] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:41:15.821625 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:15.823013 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:15.881525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c85d-3f97-41f7-9f38-c6d2f10bfbaa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:15.885217 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7e29e-c80a-45c7-b074-10b5c55bf98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:15.885823 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7e29e-c80a-45c7-b074-10b5c55bf98e service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:15.886107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7e29e-c80a-45c7-b074-10b5c55bf98e service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:15.886382 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7e29e-c80a-45c7-b074-10b5c55bf98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:15.895371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7e29e-c80a-45c7-b074-10b5c55bf98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:15.896837 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7e29e-c80a-45c7-b074-10b5c55bf98e service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:15.906731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1384/2770] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:41:16.134884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:16.136393 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:16.151842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8585d-efb7-424f-8d34-cb8b778a8556 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:16.157829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:16.158479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:16.158763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:16.159036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] PATH_INFO: `/v3/projects/09b4d12d43344204a5227e438a924c00` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:16.160229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b4d12d43344204a5227e438a924c00)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:16.162158 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:16.265394 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b4d12d43344204a5227e438a924c00', 'request_id': 'req-3d938be3-dda5-42e7-b5dd-bd5e8131afde'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:16.271451 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b4d12d43344204a5227e438a924c00', 'request_id': 'req-3d938be3-dda5-42e7-b5dd-bd5e8131afde'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:16.335161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b4d12d43344204a5227e438a924c00', 'request_id': 'req-3d938be3-dda5-42e7-b5dd-bd5e8131afde'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:16.352090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] The token cache is being invalidate because project 09b4d12d43344204a5227e438a924c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:41:16.352433 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:16.355581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:41:16.355581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1387/2771] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:41:16 2022] DELETE /identity/v3/projects/09b4d12d43344204a5227e438a924c00 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:41:25.901986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=36,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:26.348492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:32.953032 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:32.953603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:32.953603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:32.973118 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] MFA Rules not processed for user `a580c24eab0a41ceb5dbca37af5e0b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:41:32.974221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:33.031131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1385/2772] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:41:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:41:33.339045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:41:33.340496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:33.401018 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d938be3-dda5-42e7-b5dd-bd5e8131afde admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:41:33.405271 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:41:33.406109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:41:33.406390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:41:33.406662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:41:33.408464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:41:33.418550 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:41:33.419987 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:41:33.430191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1388/2773] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:41:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:41:43.023997 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=25 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:43.426000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=26 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:53.438114 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:42:53.439623 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:42:53.512905 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5118-fd85-4024-bc29-d3ac1909a78e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:42:53.518010 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25f7bf-e10a-4a70-b8d2-7c570ef51eb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:42:53.518628 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25f7bf-e10a-4a70-b8d2-7c570ef51eb1 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:42:53.518911 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25f7bf-e10a-4a70-b8d2-7c570ef51eb1 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:42:53.519186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25f7bf-e10a-4a70-b8d2-7c570ef51eb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:42:53.520970 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fe25f7bf-e10a-4a70-b8d2-7c570ef51eb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:42:53.534651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25f7bf-e10a-4a70-b8d2-7c570ef51eb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:42:53.536363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25f7bf-e10a-4a70-b8d2-7c570ef51eb1 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:42:53.548307 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1386/2774] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:42:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:43:01.864371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:43:01.865779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:43:01.941467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c8ed-9c8f-4b1f-bfae-67fe13f50d45 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:43:01.947041 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:43:01.948374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:43:01.948658 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:43:01.948955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:43:01.950681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:43:01.960786 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:43:01.962338 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:43:01.971467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1389/2775] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:43:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:43:03.543546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=32 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:11.967517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=34 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:16.280091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:43:16.280672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:43:16.280672 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:43:16.303603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] MFA Rules not processed for user `a580c24eab0a41ceb5dbca37af5e0b40`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:43:16.303603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:43:16.309519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1387/2776] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:43:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:43:16.623770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:43:16.633230 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3aae3-1913-403e-adca-ee9bb867fc8b service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:43:16.637435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:43:16.638050 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:43:16.638336 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:43:16.638613 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:43:16.640377 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:43:16.650374 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:43:16.651807 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:43:16.659769 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1390/2777] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:43:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:43:26.294599 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:26.656223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:49.932710 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:44:49.934155 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:44:49.998614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38f68-68ac-4c8a-9e47-7d0fd142dcd9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:44:50.002233 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:44:50.002842 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:44:50.003124 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:44:50.003394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:44:50.005161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:44:50.020512 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:44:50.021996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:44:50.033719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1388/2778] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:44:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:44:53.244340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:44:53.245757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:44:53.257370 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c5105-42fa-4154-b6c1-30afd09489f5 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:44:53.260991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:44:53.261599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:44:53.261880 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:44:53.262157 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:44:53.263854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:44:53.277438 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:44:53.278876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:44:53.290566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1391/2779] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:44:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:44:55.942600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:44:55.944154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:44:55.956261 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0ea5-31bf-42b1-9dad-2602e81aaace service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:44:55.960576 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:44:55.961328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:44:55.961613 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:44:55.961886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:44:55.963592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:44:55.974366 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:44:55.975797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:44:55.985536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1389/2780] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:44:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:03.285073 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:05.822046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:05.832113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9c70d-92b8-494b-9625-13480da90a0c service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:05.835763 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:05.836395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:05.836681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:05.836958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:05.838660 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:05.903604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:05.905078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:05.914840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1392/2781] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:05.980968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=32 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:09.581517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:09.583111 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:09.598886 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df078-a52c-4e84-b105-401a4e26352c service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:09.604476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:09.605600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:09.605600 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:09.605864 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:09.608011 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:09.621647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:09.624043 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:09.635922 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1390/2782] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:09.723220 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:09.724811 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:09.738150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267595a-a1d9-4bf5-9010-96d0d3af7f9d service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:09.743107 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:09.743854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:09.744142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:09.744477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] PATH_INFO: `/v3/users/a580c24eab0a41ceb5dbca37af5e0b40` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:09.745621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a580c24eab0a41ceb5dbca37af5e0b40)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:09.747547 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:09.958838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a580c24eab0a41ceb5dbca37af5e0b40'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:09.959496 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a580c24eab0a41ceb5dbca37af5e0b40'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:09.971595 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a580c24eab0a41ceb5dbca37af5e0b40'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:09.972943 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a580c24eab0a41ceb5dbca37af5e0b40'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:10.041902 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7771f8ca-7a01-4486-8dda-368995847773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a580c24eab0a41ceb5dbca37af5e0b40'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:10.054829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1393/2783] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:09 2022] DELETE /identity/v3/users/a580c24eab0a41ceb5dbca37af5e0b40 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:10.278479 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:10.290673 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694e76d-7d3e-41ae-8d4d-3adbf88ec743 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:10.350544 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:10.351189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:10.351475 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:10.351760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] PATH_INFO: `/v3/projects/6a4686f248ec45ef8973a0f370e065a7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:10.352949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4686f248ec45ef8973a0f370e065a7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:10.354858 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:10.449054 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4686f248ec45ef8973a0f370e065a7', 'request_id': 'req-d53d6326-4a3a-4f78-8193-6c35d1330f43'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:10.454829 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4686f248ec45ef8973a0f370e065a7', 'request_id': 'req-d53d6326-4a3a-4f78-8193-6c35d1330f43'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:10.462771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4686f248ec45ef8973a0f370e065a7', 'request_id': 'req-d53d6326-4a3a-4f78-8193-6c35d1330f43'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:10.543394 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] The token cache is being invalidate because project 6a4686f248ec45ef8973a0f370e065a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:10.543687 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:10.544353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d53d6326-4a3a-4f78-8193-6c35d1330f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:10.545850 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1391/2784] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:10 2022] DELETE /identity/v3/projects/6a4686f248ec45ef8973a0f370e065a7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:10.551214 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecfc71-e3c4-4506-be8c-f2347064b2eb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:10.551499 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecfc71-e3c4-4506-be8c-f2347064b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:10.551789 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecfc71-e3c4-4506-be8c-f2347064b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:10.572999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-34ecfc71-e3c4-4506-be8c-f2347064b2eb None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:10.574221 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-34ecfc71-e3c4-4506-be8c-f2347064b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:10.635581 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1394/2785] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:10.643406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b028c-cb04-4687-9c7e-e9c25e37d710 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:10.644622 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b028c-cb04-4687-9c7e-e9c25e37d710 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:10.644950 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b028c-cb04-4687-9c7e-e9c25e37d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:10.666872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e38b028c-cb04-4687-9c7e-e9c25e37d710 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:10.668091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e38b028c-cb04-4687-9c7e-e9c25e37d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:10.676800 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1392/2786] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:10.681125 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecfc71-e3c4-4506-be8c-f2347064b2eb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:10.691638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecfc71-e3c4-4506-be8c-f2347064b2eb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:10.696344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:10.696953 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:10.697239 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:10.697517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:10.698175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:45:10.698483 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:10.700075 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:10.701687 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:10.712551 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1395/2787] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:45:10.722785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b028c-cb04-4687-9c7e-e9c25e37d710 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:10.732711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b028c-cb04-4687-9c7e-e9c25e37d710 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:10.737959 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:10.738579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:10.738868 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:10.739147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:10.739783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:10.741752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:10.832579 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1393/2788] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:10 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:10.836733 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:10.846925 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301e97-3ebb-42ad-aaed-4dafd151152a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:10.906603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:10.907215 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:10.907555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:10.907834 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:10.908508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:10.910903 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:11.009090 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1396/2789] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:10 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:45:11.013732 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:11.025504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d758b1-f607-4c83-88cc-bcc089412423 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:11.030267 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:11.030869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:11.031154 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:11.031430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:11.032073 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:11.033706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:11.166703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1394/2790] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:11.170893 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:11.181606 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13fe9-d07f-4707-8762-3b8d2b2672fd admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:11.186352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebf58-caf9-4913-a89d-2fa71613a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:11.186961 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebf58-caf9-4913-a89d-2fa71613a6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:11.187246 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebf58-caf9-4913-a89d-2fa71613a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:11.187543 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebf58-caf9-4913-a89d-2fa71613a6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:11.188169 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebf58-caf9-4913-a89d-2fa71613a6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:11.189790 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebf58-caf9-4913-a89d-2fa71613a6d0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:11.201983 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1397/2791] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:11.205839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:11.216525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936dc9a-c5e7-4c43-9e17-d24552d33192 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:11.221322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:11.222102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:11.222383 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:11.222660 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] PATH_INFO: `/v3/projects/a8b7a1ff58594595865df12570aec3ee/users/6818621b98e24f408164aa2eb3472255/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:11.239389 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b7a1ff58594595865df12570aec3ee, user_id=6818621b98e24f408164aa2eb3472255, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:11.246047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:11.367977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1395/2792] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:11 2022] PUT /identity/v3/projects/a8b7a1ff58594595865df12570aec3ee/users/6818621b98e24f408164aa2eb3472255/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:11.380511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100c8c-0e31-4c01-a4cb-ecf557535798 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:11.380918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100c8c-0e31-4c01-a4cb-ecf557535798 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:11.381314 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100c8c-0e31-4c01-a4cb-ecf557535798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:11.409999 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a3100c8c-0e31-4c01-a4cb-ecf557535798 None None] MFA Rules not processed for user `6818621b98e24f408164aa2eb3472255`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:11.411231 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a3100c8c-0e31-4c01-a4cb-ecf557535798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:11.475404 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1398/2793] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:11.487180 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:11.490917 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:11.507175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:11.567029 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727902d-8dd6-4238-b347-4c54288ecff2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:11.573423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddfbd5-c714-4b5a-a3c7-c9e00788bc37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:11.574046 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddfbd5-c714-4b5a-a3c7-c9e00788bc37 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:11.574331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddfbd5-c714-4b5a-a3c7-c9e00788bc37 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:11.574609 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddfbd5-c714-4b5a-a3c7-c9e00788bc37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:11.583573 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddfbd5-c714-4b5a-a3c7-c9e00788bc37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:11.585256 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddfbd5-c714-4b5a-a3c7-c9e00788bc37 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:11.594136 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1396/2794] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:11.807403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3100c8c-0e31-4c01-a4cb-ecf557535798 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:11.870078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3100c8c-0e31-4c01-a4cb-ecf557535798 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:11.879555 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:11.880195 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:11.880512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:11.880785 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] PATH_INFO: `/v3/users/6818621b98e24f408164aa2eb3472255` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:11.881979 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6818621b98e24f408164aa2eb3472255)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:11.884037 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:11.886652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:12.082256 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6818621b98e24f408164aa2eb3472255'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:12.083053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6818621b98e24f408164aa2eb3472255'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:12.094739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6818621b98e24f408164aa2eb3472255'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:12.095371 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6818621b98e24f408164aa2eb3472255'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:12.153640 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6818621b98e24f408164aa2eb3472255'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:12.166665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1399/2795] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:11 2022] DELETE /identity/v3/users/6818621b98e24f408164aa2eb3472255 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:12.171147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:12.171665 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:12.171780 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:12.191440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:12.192669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:12.255105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1397/2796] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:12.270225 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:12.271642 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:12.330383 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d64b2-16f0-432e-9449-12abb648b72c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:12.334175 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d878aa-c5d4-48cd-ac9a-be9aa31ad5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:12.334779 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878aa-c5d4-48cd-ac9a-be9aa31ad5cb service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:12.335064 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878aa-c5d4-48cd-ac9a-be9aa31ad5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:12.335340 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878aa-c5d4-48cd-ac9a-be9aa31ad5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:12.345106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d878aa-c5d4-48cd-ac9a-be9aa31ad5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:12.346575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d878aa-c5d4-48cd-ac9a-be9aa31ad5cb service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:12.358585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1400/2797] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 11:45:12.832612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:12.834207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:12.846378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09f668-37a0-4467-8abd-d7bd82907a97 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:12.851486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:12.852321 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:12.852681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:12.853050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] PATH_INFO: `/v3/projects/a8b7a1ff58594595865df12570aec3ee` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:12.854361 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b7a1ff58594595865df12570aec3ee)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:12.856326 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:12.990688 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b7a1ff58594595865df12570aec3ee', 'request_id': 'req-84f0e8ec-c72a-4162-abaa-1b009b7fb051'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:12.996484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b7a1ff58594595865df12570aec3ee', 'request_id': 'req-84f0e8ec-c72a-4162-abaa-1b009b7fb051'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:13.002618 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b7a1ff58594595865df12570aec3ee', 'request_id': 'req-84f0e8ec-c72a-4162-abaa-1b009b7fb051'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:13.057882 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] The token cache is being invalidate because project a8b7a1ff58594595865df12570aec3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:13.058168 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:13.058773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84f0e8ec-c72a-4162-abaa-1b009b7fb051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:13.060311 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1398/2798] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:12 2022] DELETE /identity/v3/projects/a8b7a1ff58594595865df12570aec3ee => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:13.065190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035d02-c5db-4c0d-b508-cedd8eec3c0b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.066272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035d02-c5db-4c0d-b508-cedd8eec3c0b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.071529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035d02-c5db-4c0d-b508-cedd8eec3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.086700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-05035d02-c5db-4c0d-b508-cedd8eec3c0b None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:13.087898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-05035d02-c5db-4c0d-b508-cedd8eec3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:13.147474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1401/2799] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:13.155441 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1309bd0-b1eb-4712-b08e-6083c725f273 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.155737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1309bd0-b1eb-4712-b08e-6083c725f273 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.156049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1309bd0-b1eb-4712-b08e-6083c725f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.176406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c1309bd0-b1eb-4712-b08e-6083c725f273 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:13.177654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c1309bd0-b1eb-4712-b08e-6083c725f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:13.185469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1399/2800] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:13.189717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035d02-c5db-4c0d-b508-cedd8eec3c0b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:13.199945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035d02-c5db-4c0d-b508-cedd8eec3c0b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:13.204545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:13.205161 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.205442 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.205717 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.206711 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:45:13.206835 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:13.208662 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:13.220105 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1402/2801] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:45:13.225644 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1309bd0-b1eb-4712-b08e-6083c725f273 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:13.235484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1309bd0-b1eb-4712-b08e-6083c725f273 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:13.240941 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:13.241490 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.241775 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.242049 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.242723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:13.244816 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:13.260130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:13.357789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1400/2802] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:13 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:13.362092 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:13.373151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca1db-d9af-4980-b49d-3e47451f9ac9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:13.381523 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:13.433474 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:13.434106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.434383 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.434654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.435297 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:13.437253 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:13.560009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1403/2803] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:13 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:45:13.563993 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:13.576260 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fc131-92b4-4a27-abd1-de88c9c75e5f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:13.580939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:13.582221 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.582501 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.582772 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.583413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:13.585026 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:13.595165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1401/2804] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:13.600266 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:13.610505 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5e231-6f1c-44b3-8273-53c3a3aea4df admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:13.615919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744511f-5559-451b-8720-92f06d8ac801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:13.616573 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744511f-5559-451b-8720-92f06d8ac801 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.616842 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744511f-5559-451b-8720-92f06d8ac801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.617121 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744511f-5559-451b-8720-92f06d8ac801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.617768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744511f-5559-451b-8720-92f06d8ac801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:13.619379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744511f-5559-451b-8720-92f06d8ac801 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:13.629808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1404/2805] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:13.634081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:13.645929 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329edd11-de42-4421-ad03-ed19d159486d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:13.650515 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:13.651162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.651470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.651744 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] PATH_INFO: `/v3/projects/6e4c957ca42a4c4ea91eb92348dbbfe6/users/9f01a0bf8a02422badd75463436632e8/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.667697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c957ca42a4c4ea91eb92348dbbfe6, user_id=9f01a0bf8a02422badd75463436632e8, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:13.670353 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:13.767640 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1402/2806] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:13 2022] PUT /identity/v3/projects/6e4c957ca42a4c4ea91eb92348dbbfe6/users/9f01a0bf8a02422badd75463436632e8/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:13.779017 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2883-1e5e-4987-b3d5-d6eef788f233 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.779308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2883-1e5e-4987-b3d5-d6eef788f233 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.779603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2883-1e5e-4987-b3d5-d6eef788f233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.808479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1f0b2883-1e5e-4987-b3d5-d6eef788f233 None None] MFA Rules not processed for user `9f01a0bf8a02422badd75463436632e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:13.809702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1f0b2883-1e5e-4987-b3d5-d6eef788f233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:13.874448 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1405/2807] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:13.878895 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:13.941898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd65b-01db-4731-b949-76465bc355d0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:13.946590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:13.947202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:13.947485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:13.947760 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:13.948486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:13.950387 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.058519 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1403/2808] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:13 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:14.062575 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2883-1e5e-4987-b3d5-d6eef788f233 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.074096 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2883-1e5e-4987-b3d5-d6eef788f233 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.130939 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.131457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.131736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.132009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.132684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.134602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.224148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1406/2809] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:14 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:14.228402 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.239819 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377a1f-46f9-4a9f-9f87-045fe844ee42 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.244676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.245284 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.245560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.245835 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.246486 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.248064 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.259737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1404/2810] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:14.263988 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.274899 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71b7fe-c72a-4880-b72b-2e0c2a5200c7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.279409 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ae433-3205-43fa-b50e-66f0ae4f788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.280006 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ae433-3205-43fa-b50e-66f0ae4f788b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.280322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ae433-3205-43fa-b50e-66f0ae4f788b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.280599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ae433-3205-43fa-b50e-66f0ae4f788b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.281272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ae433-3205-43fa-b50e-66f0ae4f788b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.282856 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ae433-3205-43fa-b50e-66f0ae4f788b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.285460 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:14.293701 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1407/2811] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:14.298670 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.308668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115a2d9-0d27-4908-b5c2-5798ba313caf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.313315 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.313968 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.314225 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.314502 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] PATH_INFO: `/v3/projects/92b411a397a741f89efa10d486f37a48/users/741d4962092a473d89a4b19cbae8548c/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.330229 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b411a397a741f89efa10d486f37a48, user_id=741d4962092a473d89a4b19cbae8548c, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.333574 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.411123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1405/2812] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:14 2022] PUT /identity/v3/projects/92b411a397a741f89efa10d486f37a48/users/741d4962092a473d89a4b19cbae8548c/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:14.422958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2777051-ab51-4b42-b4e4-f334f0e586a6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.423117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2777051-ab51-4b42-b4e4-f334f0e586a6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.423400 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2777051-ab51-4b42-b4e4-f334f0e586a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.451655 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e2777051-ab51-4b42-b4e4-f334f0e586a6 None None] MFA Rules not processed for user `741d4962092a473d89a4b19cbae8548c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:14.452889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e2777051-ab51-4b42-b4e4-f334f0e586a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:14.516452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1408/2813] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:14.520979 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.581130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85138-9fab-4fe9-98cb-a6d6ebb03906 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.586176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.586784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.587071 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.587350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.587973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.589910 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.604169 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:14.670892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1406/2814] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:14 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:14.675541 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2777051-ab51-4b42-b4e4-f334f0e586a6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.686705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2777051-ab51-4b42-b4e4-f334f0e586a6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.743768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.744435 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.744715 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.744991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.745625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.747585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.830352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1409/2815] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:14 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:14.834924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.845082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff52a0-d42f-4cb7-9610-f95a31899f1c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.850568 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.851157 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.851513 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.851754 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.852419 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.853996 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:14.865558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1407/2816] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:14.869904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:14.879788 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf54a08-b7e6-4d16-88ff-b1fa70384b7b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:14.884378 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:14.885054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:14.885333 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:14.885608 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] PATH_INFO: `/v3/projects/4a03f6e080254092b6ba87c5704c1561/users/0a4ceb19f9b540c89773b02073728e1c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:14.900080 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a03f6e080254092b6ba87c5704c1561, user_id=0a4ceb19f9b540c89773b02073728e1c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:14.902737 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:15.005986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1410/2817] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:14 2022] PUT /identity/v3/projects/4a03f6e080254092b6ba87c5704c1561/users/0a4ceb19f9b540c89773b02073728e1c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:15.009952 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:15.020532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f34d1-f688-4864-ad5a-bfa2d1370f26 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:15.078202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e79af-4aa8-4e0b-89c1-ce594f727b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:15.078798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e79af-4aa8-4e0b-89c1-ce594f727b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:15.079082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e79af-4aa8-4e0b-89c1-ce594f727b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:15.079357 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e79af-4aa8-4e0b-89c1-ce594f727b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:15.080003 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e79af-4aa8-4e0b-89c1-ce594f727b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:15.081883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e79af-4aa8-4e0b-89c1-ce594f727b56 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:15.091953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1408/2818] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:15.096422 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:15.108504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc056582-6005-4a13-a898-a253e3f6ad3d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:15.113946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:15.114599 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:15.114878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:15.115267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] PATH_INFO: `/v3/projects/4a03f6e080254092b6ba87c5704c1561/users/0a4ceb19f9b540c89773b02073728e1c/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:15.117270 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a03f6e080254092b6ba87c5704c1561, user_id=0a4ceb19f9b540c89773b02073728e1c, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:15.119898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:15.130656 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1411/2819] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:15 2022] PUT /identity/v3/projects/4a03f6e080254092b6ba87c5704c1561/users/0a4ceb19f9b540c89773b02073728e1c/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:15.141232 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:15.141516 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:15.141807 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:15.171125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] MFA Rules not processed for user `0a4ceb19f9b540c89773b02073728e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:15.172362 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:15.243437 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1409/2820] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:15.254426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:15.256178 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:15.302033 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:15.316035 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084b422-93dc-40f1-a836-14c1471f1c84 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:15.319951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:15.320744 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:15.321024 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:15.321295 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:15.330263 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:15.332490 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:15.342657 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1412/2821] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:16.410176 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:16.411572 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:16.423488 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba3a72-0aeb-4ab1-b528-cae73166bbf6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:16.427727 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:16.429290 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:16.429577 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:16.429852 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:16.486752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:16.488797 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:16.498525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1410/2822] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:21.567234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:21.576816 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6cbc1-f1ea-4068-b8a4-8d9559a49797 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:21.582268 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ec7aa-80f2-416e-a9ca-bfde9a6654b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:21.583235 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ec7aa-80f2-416e-a9ca-bfde9a6654b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:21.583739 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ec7aa-80f2-416e-a9ca-bfde9a6654b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:21.584224 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ec7aa-80f2-416e-a9ca-bfde9a6654b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:21.652104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ec7aa-80f2-416e-a9ca-bfde9a6654b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:21.653562 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ec7aa-80f2-416e-a9ca-bfde9a6654b5 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:21.662757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1413/2823] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:25.681126 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:25.685374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:25.745924 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f6444-4330-422d-a7cb-2d37039376d1 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:25.753230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:25.753230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:25.753230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:25.753230 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] PATH_INFO: `/v3/users/9f01a0bf8a02422badd75463436632e8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:25.753785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f01a0bf8a02422badd75463436632e8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:25.755467 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:25.936320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f01a0bf8a02422badd75463436632e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:25.937044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f01a0bf8a02422badd75463436632e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:25.949728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f01a0bf8a02422badd75463436632e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:25.957462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f01a0bf8a02422badd75463436632e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:25.958205 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f01a0bf8a02422badd75463436632e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:26.002181 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1411/2824] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:25 2022] DELETE /identity/v3/users/9f01a0bf8a02422badd75463436632e8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:26.006395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:26.006870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:26.006970 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:26.026918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:26.028110 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:26.088014 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1414/2825] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:26.098139 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:26.099533 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:26.156748 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bea07-fbe2-4354-b46c-4ed2c8b5d314 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:26.161121 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:26.161729 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:26.162036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:26.162308 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:26.172424 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:26.173857 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:26.184504 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1412/2826] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:26.591765 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:26.593574 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:26.607463 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6cfc-ce67-4a49-87e5-5a5efb144d2c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:26.612971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:26.621886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:26.621886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:26.621886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] PATH_INFO: `/v3/projects/6e4c957ca42a4c4ea91eb92348dbbfe6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:26.621886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4c957ca42a4c4ea91eb92348dbbfe6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:26.621886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:26.744591 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4c957ca42a4c4ea91eb92348dbbfe6', 'request_id': 'req-c18653ce-4c58-4b05-bef2-738845685807'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:26.750052 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4c957ca42a4c4ea91eb92348dbbfe6', 'request_id': 'req-c18653ce-4c58-4b05-bef2-738845685807'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:26.833597 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4c957ca42a4c4ea91eb92348dbbfe6', 'request_id': 'req-c18653ce-4c58-4b05-bef2-738845685807'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:26.845666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] The token cache is being invalidate because project 6e4c957ca42a4c4ea91eb92348dbbfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:26.845958 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:26.846887 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:26.848480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1415/2827] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:26 2022] DELETE /identity/v3/projects/6e4c957ca42a4c4ea91eb92348dbbfe6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:26.852787 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:26.864152 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e961e-a063-4c86-bd1e-f86625dbc9cd service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:26.885700 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:26.925824 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:26.926639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:26.927202 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:26.927650 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] PATH_INFO: `/v3/users/741d4962092a473d89a4b19cbae8548c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:26.929532 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=741d4962092a473d89a4b19cbae8548c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:26.931518 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:27.159548 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741d4962092a473d89a4b19cbae8548c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:27.160268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741d4962092a473d89a4b19cbae8548c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:27.180840 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741d4962092a473d89a4b19cbae8548c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:27.187776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741d4962092a473d89a4b19cbae8548c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:27.188527 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741d4962092a473d89a4b19cbae8548c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:27.275948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1413/2828] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:26 2022] DELETE /identity/v3/users/741d4962092a473d89a4b19cbae8548c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:27.721977 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:27.723540 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:27.733746 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:27.738500 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18653ce-4c58-4b05-bef2-738845685807 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:27.804507 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:27.805194 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:27.805478 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:27.805757 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] PATH_INFO: `/v3/projects/92b411a397a741f89efa10d486f37a48` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:27.806904 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b411a397a741f89efa10d486f37a48)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:27.808845 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:27.928702 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b411a397a741f89efa10d486f37a48', 'request_id': 'req-7d907c68-2c0a-4b90-9ab5-f60953d6910a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:27.934313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b411a397a741f89efa10d486f37a48', 'request_id': 'req-7d907c68-2c0a-4b90-9ab5-f60953d6910a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.029793 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b411a397a741f89efa10d486f37a48', 'request_id': 'req-7d907c68-2c0a-4b90-9ab5-f60953d6910a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.042276 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] The token cache is being invalidate because project 92b411a397a741f89efa10d486f37a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:28.042572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.044358 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.044803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1416/2829] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:27 2022] DELETE /identity/v3/projects/92b411a397a741f89efa10d486f37a48 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:28.048966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:28.050653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:28.064580 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76275fb2-5f7c-46f5-a61e-fddc14131226 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:28.126349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:28.127079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:28.127561 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:28.127999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] PATH_INFO: `/v3/users/0a4ceb19f9b540c89773b02073728e1c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:28.129318 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4ceb19f9b540c89773b02073728e1c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:28.131222 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:28.346651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:28.348633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4ceb19f9b540c89773b02073728e1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.349296 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4ceb19f9b540c89773b02073728e1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.361793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4ceb19f9b540c89773b02073728e1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.369178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4ceb19f9b540c89773b02073728e1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.369885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a8470d98-3cd4-4ba2-97c8-65788b2b8ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4ceb19f9b540c89773b02073728e1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:28.464517 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1414/2830] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:28 2022] DELETE /identity/v3/users/0a4ceb19f9b540c89773b02073728e1c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:45:28.900942 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:28.902552 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:28.917838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d907c68-2c0a-4b90-9ab5-f60953d6910a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:28.983890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:28.984566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:28.984848 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:28.985122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] PATH_INFO: `/v3/projects/4a03f6e080254092b6ba87c5704c1561` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:28.986249 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a03f6e080254092b6ba87c5704c1561)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:28.988991 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:29.073643 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:29.082909 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a03f6e080254092b6ba87c5704c1561', 'request_id': 'req-dbde7367-1bc7-44a3-b746-54800c72e0b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:29.088604 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a03f6e080254092b6ba87c5704c1561', 'request_id': 'req-dbde7367-1bc7-44a3-b746-54800c72e0b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:29.153802 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a03f6e080254092b6ba87c5704c1561', 'request_id': 'req-dbde7367-1bc7-44a3-b746-54800c72e0b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:29.167163 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] The token cache is being invalidate because project 4a03f6e080254092b6ba87c5704c1561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:29.167464 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:29.168147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-dbde7367-1bc7-44a3-b746-54800c72e0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:29.169723 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1417/2831] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:28 2022] DELETE /identity/v3/projects/4a03f6e080254092b6ba87c5704c1561 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:29.178615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740548-c278-49e1-bf72-2dd9126fc665 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.179430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740548-c278-49e1-bf72-2dd9126fc665 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.179430 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740548-c278-49e1-bf72-2dd9126fc665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.200432 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dc740548-c278-49e1-bf72-2dd9126fc665 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:29.201705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dc740548-c278-49e1-bf72-2dd9126fc665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:29.271699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1415/2832] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:45:29.281360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe30d5-9f51-4010-aeff-2ce3a06f16f6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.281644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe30d5-9f51-4010-aeff-2ce3a06f16f6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.281920 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe30d5-9f51-4010-aeff-2ce3a06f16f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.303787 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b5fe30d5-9f51-4010-aeff-2ce3a06f16f6 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:29.305044 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b5fe30d5-9f51-4010-aeff-2ce3a06f16f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:29.313001 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1418/2833] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:29.317793 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc740548-c278-49e1-bf72-2dd9126fc665 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:29.327633 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc740548-c278-49e1-bf72-2dd9126fc665 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:29.332453 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:29.333061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.333346 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.333619 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.334276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:45:29.334584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:29.336184 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:29.348785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1416/2834] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:45:29.353281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe30d5-9f51-4010-aeff-2ce3a06f16f6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:29.364005 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe30d5-9f51-4010-aeff-2ce3a06f16f6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:29.368727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:29.369332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.369611 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.369882 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.370512 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:29.372459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:29.476103 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1419/2835] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:29 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:29.480329 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:29.490863 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb205c-bbfc-4bbb-b60d-7b9badb61b8d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:29.547386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:29.548012 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.548320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.548597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.549340 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:29.551584 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:29.625082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1417/2836] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:29 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:45:29.629470 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:29.640119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89867399-b1d9-4275-add9-75e78a9d6420 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:29.645628 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:29.646243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.646530 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.646810 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.647459 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:29.649104 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:29.660625 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1420/2837] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:29.665283 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:29.675720 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8946-dccf-4959-9d60-12f8a720bad1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:29.680485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931cdc7-5f2f-4003-9151-a56b3f9f3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:29.681091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931cdc7-5f2f-4003-9151-a56b3f9f3a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.681377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931cdc7-5f2f-4003-9151-a56b3f9f3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.681654 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931cdc7-5f2f-4003-9151-a56b3f9f3a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.682309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931cdc7-5f2f-4003-9151-a56b3f9f3a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:29.683907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931cdc7-5f2f-4003-9151-a56b3f9f3a10 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:29.694998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1418/2838] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:29.699749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:29.711443 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f94502-33a6-4224-9a9d-743fc71528ad admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:29.716261 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:29.717539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.717539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.717539 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] PATH_INFO: `/v3/projects/9c618adef5c347c1a18b4d11a1a1f726/users/cfb5033d9375476abc6c414287f57c71/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.733673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c618adef5c347c1a18b4d11a1a1f726, user_id=cfb5033d9375476abc6c414287f57c71, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:29.736258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:29.796039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1421/2839] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:29 2022] PUT /identity/v3/projects/9c618adef5c347c1a18b4d11a1a1f726/users/cfb5033d9375476abc6c414287f57c71/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:45:29.807949 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ef14-c5ee-4f8e-aad5-4e3461170f69 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.808269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ef14-c5ee-4f8e-aad5-4e3461170f69 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.808551 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9ef14-c5ee-4f8e-aad5-4e3461170f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.839553 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-70b9ef14-c5ee-4f8e-aad5-4e3461170f69 None None] MFA Rules not processed for user `cfb5033d9375476abc6c414287f57c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:29.840798 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-70b9ef14-c5ee-4f8e-aad5-4e3461170f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:29.859165 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:29.909535 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1419/2840] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 11:45:29.914122 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:29.979017 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82dc7-a212-4724-b941-4a94761b136e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:29.984007 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:29.984603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:29.984884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:29.985155 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:29.985954 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:29.988768 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:30.081918 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1422/2841] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:29 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:45:30.085974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9ef14-c5ee-4f8e-aad5-4e3461170f69 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:30.097904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9ef14-c5ee-4f8e-aad5-4e3461170f69 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:30.158320 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:30.159208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:30.159492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:30.159771 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:30.160483 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:30.162450 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:30.276614 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1420/2842] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:30 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 11:45:30.282217 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:30.296349 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cbc78-00c7-4b40-9130-fb4e9f4cc724 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:30.302061 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:30.302676 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:30.302950 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:30.306956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:30.306956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:30.306956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:30.318149 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1423/2843] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:30.322938 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:30.334000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997a211-7ce6-41be-b689-8dd3f4eb7675 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:30.338725 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:30.339386 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:30.339669 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:30.339991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] PATH_INFO: `/v3/projects/1f8b05e72e984c2da1159c12c7dd7655/users/7f14d675fe6645feb8e92eb3a4cf3474/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:30.354707 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8b05e72e984c2da1159c12c7dd7655, user_id=7f14d675fe6645feb8e92eb3a4cf3474, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:30.357717 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:30.459348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1421/2844] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:30 2022] PUT /identity/v3/projects/1f8b05e72e984c2da1159c12c7dd7655/users/7f14d675fe6645feb8e92eb3a4cf3474/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:45:30.463708 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:30.474736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efd895-a76c-441f-8030-291f8849b162 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:30.510803 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:30.537578 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa8d2-5257-4a7d-820f-c90ca04e2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:30.538198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa8d2-5257-4a7d-820f-c90ca04e2c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:30.538480 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa8d2-5257-4a7d-820f-c90ca04e2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:30.538754 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa8d2-5257-4a7d-820f-c90ca04e2c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:30.539396 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa8d2-5257-4a7d-820f-c90ca04e2c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:30.541025 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa8d2-5257-4a7d-820f-c90ca04e2c77 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:30.552332 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1424/2845] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 11:45:30.556789 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:30.567151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb8d6-1837-4d7f-9b90-1282ce6a32b4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:30.572044 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:30.572723 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:30.573001 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:30.573270 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] PATH_INFO: `/v3/projects/1f8b05e72e984c2da1159c12c7dd7655/users/7f14d675fe6645feb8e92eb3a4cf3474/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:30.575201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8b05e72e984c2da1159c12c7dd7655, user_id=7f14d675fe6645feb8e92eb3a4cf3474, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:30.577896 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:30.589287 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1422/2846] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:30 2022] PUT /identity/v3/projects/1f8b05e72e984c2da1159c12c7dd7655/users/7f14d675fe6645feb8e92eb3a4cf3474/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:30.601053 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248a39-18b9-473a-a3f9-706a2d06feda None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:30.601390 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248a39-18b9-473a-a3f9-706a2d06feda None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:30.601749 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248a39-18b9-473a-a3f9-706a2d06feda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:30.631100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d6248a39-18b9-473a-a3f9-706a2d06feda None None] MFA Rules not processed for user `7f14d675fe6645feb8e92eb3a4cf3474`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:30.632361 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d6248a39-18b9-473a-a3f9-706a2d06feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:30.702323 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1425/2847] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:30.713531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:30.715203 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:30.776509 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a010f45-ef26-4ca4-975b-099f87bd770a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:30.780161 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90f84c-d934-4310-9374-f004bf9f4f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:30.780806 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90f84c-d934-4310-9374-f004bf9f4f0d service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:30.781091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90f84c-d934-4310-9374-f004bf9f4f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:30.781374 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90f84c-d934-4310-9374-f004bf9f4f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:30.795039 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90f84c-d934-4310-9374-f004bf9f4f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:30.796443 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90f84c-d934-4310-9374-f004bf9f4f0d service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:30.807057 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1423/2848] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:31.982357 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6248a39-18b9-473a-a3f9-706a2d06feda None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:32.049679 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6248a39-18b9-473a-a3f9-706a2d06feda None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:32.054334 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:32.054971 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:32.055258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:32.055535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] PATH_INFO: `/v3/users/cfb5033d9375476abc6c414287f57c71` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:32.056693 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb5033d9375476abc6c414287f57c71)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:32.058616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:32.231329 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb5033d9375476abc6c414287f57c71'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:32.232411 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb5033d9375476abc6c414287f57c71'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:32.241031 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:32.245528 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb5033d9375476abc6c414287f57c71'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:32.249758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb5033d9375476abc6c414287f57c71'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:32.321965 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb5033d9375476abc6c414287f57c71'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:32.335027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1426/2849] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:31 2022] DELETE /identity/v3/users/cfb5033d9375476abc6c414287f57c71 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:32.339697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:32.340183 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:32.340316 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:32.360697 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:32.362703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:32.371045 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:32.422024 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1424/2850] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:32.431890 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:32.433352 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:32.493801 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74458-772a-48a2-8a31-8482a3db90df admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:32.497421 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:32.498029 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:32.498309 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:32.498579 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:32.508026 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:32.509482 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:32.519554 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1427/2851] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:33.035286 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:33.036817 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:33.050378 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2884ef0-4ae1-4fd3-a056-5714ad1c9ebd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:33.057901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:33.059051 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:33.059558 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:33.060055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] PATH_INFO: `/v3/projects/9c618adef5c347c1a18b4d11a1a1f726` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:33.062173 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c618adef5c347c1a18b4d11a1a1f726)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:33.065499 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:33.192196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c618adef5c347c1a18b4d11a1a1f726', 'request_id': 'req-1dbb8978-0eeb-4f91-8bfe-58aa79725991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.197761 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c618adef5c347c1a18b4d11a1a1f726', 'request_id': 'req-1dbb8978-0eeb-4f91-8bfe-58aa79725991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.204251 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c618adef5c347c1a18b4d11a1a1f726', 'request_id': 'req-1dbb8978-0eeb-4f91-8bfe-58aa79725991'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.274973 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] The token cache is being invalidate because project 9c618adef5c347c1a18b4d11a1a1f726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:33.275262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.275898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.277403 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1425/2852] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:33 2022] DELETE /identity/v3/projects/9c618adef5c347c1a18b4d11a1a1f726 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:33.281412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:33.291385 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4b19-58ca-47ed-83ed-3484e828e8df service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:33.356935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:33.357571 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:33.357850 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:33.358123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] PATH_INFO: `/v3/users/7f14d675fe6645feb8e92eb3a4cf3474` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:33.359258 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f14d675fe6645feb8e92eb3a4cf3474)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:33.361198 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:33.576936 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f14d675fe6645feb8e92eb3a4cf3474'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.577527 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f14d675fe6645feb8e92eb3a4cf3474'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.590240 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f14d675fe6645feb8e92eb3a4cf3474'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.591046 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f14d675fe6645feb8e92eb3a4cf3474'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.652426 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-44db8228-19fa-4184-8ea4-c2c62d52d639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f14d675fe6645feb8e92eb3a4cf3474'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:33.662674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:33.668040 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1428/2853] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:33 2022] DELETE /identity/v3/users/7f14d675fe6645feb8e92eb3a4cf3474 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:34.127258 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:34.129201 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:34.144892 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb8978-0eeb-4f91-8bfe-58aa79725991 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:34.208630 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:34.209411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:34.209696 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:34.210016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] PATH_INFO: `/v3/projects/1f8b05e72e984c2da1159c12c7dd7655` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:34.211129 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8b05e72e984c2da1159c12c7dd7655)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:34.213108 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:34.337827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:34.345061 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8b05e72e984c2da1159c12c7dd7655', 'request_id': 'req-6577bc77-cedc-4597-bbc1-8b06af78c794'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:34.351597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8b05e72e984c2da1159c12c7dd7655', 'request_id': 'req-6577bc77-cedc-4597-bbc1-8b06af78c794'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:34.358159 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8b05e72e984c2da1159c12c7dd7655', 'request_id': 'req-6577bc77-cedc-4597-bbc1-8b06af78c794'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:34.433084 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] The token cache is being invalidate because project 1f8b05e72e984c2da1159c12c7dd7655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:34.433300 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:34.433939 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6577bc77-cedc-4597-bbc1-8b06af78c794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:34.435472 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1426/2854] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:34 2022] DELETE /identity/v3/projects/1f8b05e72e984c2da1159c12c7dd7655 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:34.441228 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105435a-e4a2-4075-b036-a466c7fead88 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:34.441730 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105435a-e4a2-4075-b036-a466c7fead88 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:34.441855 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105435a-e4a2-4075-b036-a466c7fead88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:34.462798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9105435a-e4a2-4075-b036-a466c7fead88 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:34.464008 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9105435a-e4a2-4075-b036-a466c7fead88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:34.528633 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1429/2855] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:34.594363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd1b5-e88d-49a6-a4f8-de492a107655 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:34.594648 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd1b5-e88d-49a6-a4f8-de492a107655 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:34.594925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdd1b5-e88d-49a6-a4f8-de492a107655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:34.615405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5dfdd1b5-e88d-49a6-a4f8-de492a107655 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:34.616991 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5dfdd1b5-e88d-49a6-a4f8-de492a107655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:34.625592 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1427/2856] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:34.630837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105435a-e4a2-4075-b036-a466c7fead88 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:34.641132 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105435a-e4a2-4075-b036-a466c7fead88 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:34.647062 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:34.651884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:34.651884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:34.651884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:34.651884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:45:34.651884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:34.651884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:34.663497 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1430/2857] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:45:34.668728 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdd1b5-e88d-49a6-a4f8-de492a107655 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:34.679639 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdd1b5-e88d-49a6-a4f8-de492a107655 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:34.684531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:34.685082 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:34.685375 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:34.685651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:34.686289 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:34.688197 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:34.785591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1428/2858] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:34 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:34.789820 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:34.800829 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9761206-6e2d-4f2b-bd18-f5621b01957d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:34.860630 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:34.861798 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:34.862144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:34.862436 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:34.863148 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:34.865136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:34.977118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1431/2859] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:34 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:34.981641 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:34.992709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc839b-f939-4b97-9832-8b4d78ac4419 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:34.997549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:34.998147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:34.998427 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:34.998702 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:34.999344 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.000974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.012238 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1429/2860] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:35.016286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.027359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add316f-c73f-4661-8ca8-ee3c7263eefb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.032373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2819a-3b70-4dd7-a01a-44430ab974a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.033009 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2819a-3b70-4dd7-a01a-44430ab974a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.033998 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2819a-3b70-4dd7-a01a-44430ab974a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.034290 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2819a-3b70-4dd7-a01a-44430ab974a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.034959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2819a-3b70-4dd7-a01a-44430ab974a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.036616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2819a-3b70-4dd7-a01a-44430ab974a8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.048012 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1432/2861] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:35.052956 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.063179 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cc15a-7471-4ca4-9233-0b0a9a2e195b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.068265 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.068934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.069213 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.069485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] PATH_INFO: `/v3/projects/60f482ad5f89472197370433a41ece5c/users/8762c5ed5e6c49b4be25590ca162bc37/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.085081 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f482ad5f89472197370433a41ece5c, user_id=8762c5ed5e6c49b4be25590ca162bc37, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.087731 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.153995 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1430/2862] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:35 2022] PUT /identity/v3/projects/60f482ad5f89472197370433a41ece5c/users/8762c5ed5e6c49b4be25590ca162bc37/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:35.164854 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf505a2-8f21-4ca6-a283-c46d56b2d1cf None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.165138 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf505a2-8f21-4ca6-a283-c46d56b2d1cf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.165416 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf505a2-8f21-4ca6-a283-c46d56b2d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.194116 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0bf505a2-8f21-4ca6-a283-c46d56b2d1cf None None] MFA Rules not processed for user `8762c5ed5e6c49b4be25590ca162bc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:35.195337 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0bf505a2-8f21-4ca6-a283-c46d56b2d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:35.253242 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:35.267629 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1433/2863] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:35.272299 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.336683 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191f55-197e-46ba-b2ba-1fdabd056704 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.341653 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.342275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.342557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.342832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.343470 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.345505 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.437314 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1431/2864] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:35 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:35.441935 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf505a2-8f21-4ca6-a283-c46d56b2d1cf None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.453111 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf505a2-8f21-4ca6-a283-c46d56b2d1cf None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.511673 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.512199 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.512511 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.512783 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.513445 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.515363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.605857 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1434/2865] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:35 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:35.610335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.621359 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c150a5-38bf-48ed-a60d-ea58edae4d4c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.626175 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.627000 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.627341 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.627617 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.628334 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.629937 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.642036 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1432/2866] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:35.647919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.659126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae75623-e3db-4cf5-982f-28a43b0f4b5e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.664172 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.664898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.665286 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.665566 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] PATH_INFO: `/v3/projects/d8ae9b2d579747a28cb68f568f71478b/users/5b10dc1cfdec494bb9548a0d6673ef51/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.681638 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ae9b2d579747a28cb68f568f71478b, user_id=5b10dc1cfdec494bb9548a0d6673ef51, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.684354 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.753373 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1435/2867] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:35 2022] PUT /identity/v3/projects/d8ae9b2d579747a28cb68f568f71478b/users/5b10dc1cfdec494bb9548a0d6673ef51/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:35.757454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.768107 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05cb4b-6e48-4b82-b74b-b158ca872c95 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.802961 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:35.826986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db15cc-c1d3-4968-ae4d-51a6bbd43cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.827598 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db15cc-c1d3-4968-ae4d-51a6bbd43cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.827879 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db15cc-c1d3-4968-ae4d-51a6bbd43cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.828156 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db15cc-c1d3-4968-ae4d-51a6bbd43cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.828828 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db15cc-c1d3-4968-ae4d-51a6bbd43cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.831016 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db15cc-c1d3-4968-ae4d-51a6bbd43cd8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.842262 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1433/2868] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:35.846799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:35.859945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e00ac-3f8b-4e71-bf48-ec574d5750e2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:35.864973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:35.866837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.866837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.866837 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] PATH_INFO: `/v3/projects/d8ae9b2d579747a28cb68f568f71478b/users/5b10dc1cfdec494bb9548a0d6673ef51/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.868203 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ae9b2d579747a28cb68f568f71478b, user_id=5b10dc1cfdec494bb9548a0d6673ef51, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:35.870866 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:35.882825 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1436/2869] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:35 2022] PUT /identity/v3/projects/d8ae9b2d579747a28cb68f568f71478b/users/5b10dc1cfdec494bb9548a0d6673ef51/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:35.895885 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238dba2-111a-4853-b527-cf1356c64c43 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:35.896178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238dba2-111a-4853-b527-cf1356c64c43 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:35.896493 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238dba2-111a-4853-b527-cf1356c64c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:35.926031 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1238dba2-111a-4853-b527-cf1356c64c43 None None] MFA Rules not processed for user `5b10dc1cfdec494bb9548a0d6673ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:35.927269 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1238dba2-111a-4853-b527-cf1356c64c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:36.000276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1434/2870] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:36.012168 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:36.013889 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:36.077174 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20716f6-7c58-4d36-9b41-80fe1a5796a5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:36.081719 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d70d-a495-49bd-83cb-f17f1a63bafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:36.082353 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d70d-a495-49bd-83cb-f17f1a63bafe service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:36.082646 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d70d-a495-49bd-83cb-f17f1a63bafe service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:36.082912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d70d-a495-49bd-83cb-f17f1a63bafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:36.140610 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d70d-a495-49bd-83cb-f17f1a63bafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:36.142054 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d70d-a495-49bd-83cb-f17f1a63bafe service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:36.147503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:36.152272 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1437/2871] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:39.395209 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238dba2-111a-4853-b527-cf1356c64c43 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:39.457224 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238dba2-111a-4853-b527-cf1356c64c43 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:39.461693 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:39.462319 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:39.462597 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:39.462869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] PATH_INFO: `/v3/users/8762c5ed5e6c49b4be25590ca162bc37` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:39.463980 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8762c5ed5e6c49b4be25590ca162bc37)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:39.465925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:39.642208 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8762c5ed5e6c49b4be25590ca162bc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:39.643799 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8762c5ed5e6c49b4be25590ca162bc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:39.654376 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:39.656612 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8762c5ed5e6c49b4be25590ca162bc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:39.663768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8762c5ed5e6c49b4be25590ca162bc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:39.669608 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8762c5ed5e6c49b4be25590ca162bc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:39.736440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1435/2872] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:39 2022] DELETE /identity/v3/users/8762c5ed5e6c49b4be25590ca162bc37 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:39.741504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:39.742027 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:39.742147 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:39.761705 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:39.763339 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:39.821429 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1438/2873] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:39.831776 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:39.833313 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:39.893741 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71b73f-12e4-4be5-935d-233cea491253 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:39.897538 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:39.898151 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:39.898429 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:39.898701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:39.908431 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:39.910091 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:39.920282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1436/2874] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:40.349525 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:40.350947 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:40.364133 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc025786-a24c-4184-bce3-48f3a95ff82d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:40.368946 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:40.369572 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:40.369851 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:40.370130 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] PATH_INFO: `/v3/projects/60f482ad5f89472197370433a41ece5c` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:40.371288 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f482ad5f89472197370433a41ece5c)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:40.373267 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:40.497346 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f482ad5f89472197370433a41ece5c', 'request_id': 'req-2389185d-a686-426f-a47c-364f0384c325'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.503565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f482ad5f89472197370433a41ece5c', 'request_id': 'req-2389185d-a686-426f-a47c-364f0384c325'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.578023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f482ad5f89472197370433a41ece5c', 'request_id': 'req-2389185d-a686-426f-a47c-364f0384c325'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.592647 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] The token cache is being invalidate because project 60f482ad5f89472197370433a41ece5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:40.604078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.604078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.604078 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1439/2875] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:40 2022] DELETE /identity/v3/projects/60f482ad5f89472197370433a41ece5c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:40.604485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:40.609719 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4cc48-60b6-4105-801a-45ab1979cf18 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:40.674023 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:40.674986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:40.675328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:40.675607 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] PATH_INFO: `/v3/users/5b10dc1cfdec494bb9548a0d6673ef51` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:40.676778 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b10dc1cfdec494bb9548a0d6673ef51)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:40.678703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:40.893520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b10dc1cfdec494bb9548a0d6673ef51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.894174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b10dc1cfdec494bb9548a0d6673ef51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.906385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b10dc1cfdec494bb9548a0d6673ef51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.914263 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b10dc1cfdec494bb9548a0d6673ef51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:40.914999 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e9c1f121-89d9-4ae3-9907-31a07c2dccd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b10dc1cfdec494bb9548a0d6673ef51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:41.000525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:41.005591 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1437/2876] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:45:40 2022] DELETE /identity/v3/users/5b10dc1cfdec494bb9548a0d6673ef51 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:41.397345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:41.398799 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:41.415112 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389185d-a686-426f-a47c-364f0384c325 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:41.481452 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:41.482113 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:41.482395 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:41.482666 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] PATH_INFO: `/v3/projects/d8ae9b2d579747a28cb68f568f71478b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:41.483884 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ae9b2d579747a28cb68f568f71478b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:41.485841 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:41.597709 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:41.617380 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ae9b2d579747a28cb68f568f71478b', 'request_id': 'req-43b9d41e-f6d3-48a1-a999-79e423d40481'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:41.622758 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ae9b2d579747a28cb68f568f71478b', 'request_id': 'req-43b9d41e-f6d3-48a1-a999-79e423d40481'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:41.686627 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ae9b2d579747a28cb68f568f71478b', 'request_id': 'req-43b9d41e-f6d3-48a1-a999-79e423d40481'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:41.699359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] The token cache is being invalidate because project d8ae9b2d579747a28cb68f568f71478b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:45:41.699649 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:41.700319 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-43b9d41e-f6d3-48a1-a999-79e423d40481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:45:41.701800 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1440/2877] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:45:41 2022] DELETE /identity/v3/projects/d8ae9b2d579747a28cb68f568f71478b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:45:41.707589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608e22-b29c-4340-8059-ec1be57c636f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:41.708105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608e22-b29c-4340-8059-ec1be57c636f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:41.708252 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55608e22-b29c-4340-8059-ec1be57c636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:41.729268 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-55608e22-b29c-4340-8059-ec1be57c636f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:41.730536 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55608e22-b29c-4340-8059-ec1be57c636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:41.791149 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1438/2878] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:41.798915 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aad54-ad37-4488-a6f9-3c53e1041274 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:41.799304 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aad54-ad37-4488-a6f9-3c53e1041274 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:41.799585 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aad54-ad37-4488-a6f9-3c53e1041274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:41.820681 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-744aad54-ad37-4488-a6f9-3c53e1041274 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:41.821870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-744aad54-ad37-4488-a6f9-3c53e1041274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:41.830491 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1441/2879] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:41.835206 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55608e22-b29c-4340-8059-ec1be57c636f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:41.844955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55608e22-b29c-4340-8059-ec1be57c636f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:41.849476 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:41.850069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:41.850400 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:41.850701 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:41.851349 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:45:41.851651 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:41.853264 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:41.865377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1439/2880] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:45:41.869833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aad54-ad37-4488-a6f9-3c53e1041274 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:41.879859 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aad54-ad37-4488-a6f9-3c53e1041274 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:41.884928 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:41.890603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:41.890603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:41.890603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:41.890603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:41.890603 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:42.013990 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1442/2881] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:45:41 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:42.019133 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:42.029097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea91cd-4865-4f0c-991d-796f6ebd8402 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:42.084610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:42.085330 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:42.085610 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:42.085884 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:42.086520 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:42.088462 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:42.198916 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1440/2882] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:45:42 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:45:42.203565 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:42.215039 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28bc4b-df38-4ec6-ae7d-d83a56c35d88 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:42.219738 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:42.220407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:42.220690 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:42.220967 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:42.221621 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:42.223222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:42.233838 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1443/2883] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:42.238668 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:42.248839 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb600a-57f7-4dee-af72-f1f8d815f83e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:42.254336 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421d20c-6619-42d1-9c58-38c4e10c3cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:42.254935 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421d20c-6619-42d1-9c58-38c4e10c3cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:42.255216 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421d20c-6619-42d1-9c58-38c4e10c3cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:42.255492 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421d20c-6619-42d1-9c58-38c4e10c3cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:42.256192 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421d20c-6619-42d1-9c58-38c4e10c3cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:42.257827 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421d20c-6619-42d1-9c58-38c4e10c3cc7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:42.268919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1441/2884] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:45:42.272870 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:42.283127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e68b-0f0b-43a1-afd2-059891aa8126 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:42.287912 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:42.288652 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:42.288951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:42.289226 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] PATH_INFO: `/v3/projects/855bb3f841284042bce1e4591bbbf5e4/users/4545bebf5cce4a8b82f1b909ae9108de/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:42.304516 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=855bb3f841284042bce1e4591bbbf5e4, user_id=4545bebf5cce4a8b82f1b909ae9108de, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:42.307145 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:42.406545 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1444/2885] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:45:42 2022] PUT /identity/v3/projects/855bb3f841284042bce1e4591bbbf5e4/users/4545bebf5cce4a8b82f1b909ae9108de/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:45:42.416951 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642283-f00e-4bde-a06c-6bcad33e5fc4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:42.417282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642283-f00e-4bde-a06c-6bcad33e5fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:42.417637 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642283-f00e-4bde-a06c-6bcad33e5fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:42.446350 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-96642283-f00e-4bde-a06c-6bcad33e5fc4 None None] MFA Rules not processed for user `4545bebf5cce4a8b82f1b909ae9108de`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:45:42.447540 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-96642283-f00e-4bde-a06c-6bcad33e5fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:42.500870 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:42.510601 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1442/2886] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:45:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:45:42.521914 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:45:42.523558 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:45:42.581636 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b14b4b-0b0f-4bb2-b51a-05955ab46c5f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:45:42.585345 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e5eb3-10da-442a-96d1-69986015ae15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bc29638c1994ab09ea1b1f7c7f247ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:45:42.585955 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e5eb3-10da-442a-96d1-69986015ae15 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:45:42.586229 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e5eb3-10da-442a-96d1-69986015ae15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:45:42.586504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e5eb3-10da-442a-96d1-69986015ae15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:45:42.594795 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e5eb3-10da-442a-96d1-69986015ae15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:45:42.597002 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e5eb3-10da-442a-96d1-69986015ae15 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:45:42.605644 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1445/2887] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:45:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:52.563791 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:52.601704 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:22.506207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96642283-f00e-4bde-a06c-6bcad33e5fc4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:22.575274 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96642283-f00e-4bde-a06c-6bcad33e5fc4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:22.580189 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:22.581017 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:22.581297 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:22.581570 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] PATH_INFO: `/v3/users/4545bebf5cce4a8b82f1b909ae9108de` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:22.582690 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4545bebf5cce4a8b82f1b909ae9108de)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:22.584656 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:22.768709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4545bebf5cce4a8b82f1b909ae9108de'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:22.769335 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4545bebf5cce4a8b82f1b909ae9108de'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:22.782674 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4545bebf5cce4a8b82f1b909ae9108de'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:22.789785 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4545bebf5cce4a8b82f1b909ae9108de'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:22.791196 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4545bebf5cce4a8b82f1b909ae9108de'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:22.873390 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1443/2888] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:46:22 2022] DELETE /identity/v3/users/4545bebf5cce4a8b82f1b909ae9108de => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:46:22.879183 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:22.879661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:22.879796 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:22.902515 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:22.903716 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:22.965951 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1446/2889] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:22.975676 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:22.977097 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:23.035812 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e95d-d652-45b3-b86b-031a323c6c8c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:23.039440 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d4c9-f617-481f-82f5-d8878ec1a431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:23.040047 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d4c9-f617-481f-82f5-d8878ec1a431 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:23.040439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d4c9-f617-481f-82f5-d8878ec1a431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:23.040866 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d4c9-f617-481f-82f5-d8878ec1a431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:23.049977 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d4c9-f617-481f-82f5-d8878ec1a431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:23.051392 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d4c9-f617-481f-82f5-d8878ec1a431 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:23.060783 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1444/2890] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:46:23.474933 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:23.476386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:23.488492 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ff103-7616-4c53-b3e9-7028e7d56873 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:23.494227 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:23.494957 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:23.495233 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:23.495503 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] PATH_INFO: `/v3/projects/855bb3f841284042bce1e4591bbbf5e4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:23.496699 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855bb3f841284042bce1e4591bbbf5e4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:23.498847 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:23.612826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855bb3f841284042bce1e4591bbbf5e4', 'request_id': 'req-4daf638b-12d9-4bf8-845f-40b753ba4cd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:23.618479 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855bb3f841284042bce1e4591bbbf5e4', 'request_id': 'req-4daf638b-12d9-4bf8-845f-40b753ba4cd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:23.697084 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855bb3f841284042bce1e4591bbbf5e4', 'request_id': 'req-4daf638b-12d9-4bf8-845f-40b753ba4cd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:23.708694 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] The token cache is being invalidate because project 855bb3f841284042bce1e4591bbbf5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:46:23.708985 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:23.709635 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4daf638b-12d9-4bf8-845f-40b753ba4cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:46:23.711118 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1447/2891] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:46:23 2022] DELETE /identity/v3/projects/855bb3f841284042bce1e4591bbbf5e4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:46:23.716508 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b92-bdc1-4d4d-aa61-d5e381ab2dc0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:23.720784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b92-bdc1-4d4d-aa61-d5e381ab2dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:23.720784 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f820b92-bdc1-4d4d-aa61-d5e381ab2dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:23.738411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7f820b92-bdc1-4d4d-aa61-d5e381ab2dc0 None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:23.739595 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7f820b92-bdc1-4d4d-aa61-d5e381ab2dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:23.757088 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:23.801484 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1445/2892] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:23.809944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b18e40-470e-45c0-92cf-b5110fcfb55f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:23.810234 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b18e40-470e-45c0-92cf-b5110fcfb55f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:23.810510 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b18e40-470e-45c0-92cf-b5110fcfb55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:23.829878 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-53b18e40-470e-45c0-92cf-b5110fcfb55f None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:23.831131 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-53b18e40-470e-45c0-92cf-b5110fcfb55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:23.839016 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1448/2893] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:23.843186 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820b92-bdc1-4d4d-aa61-d5e381ab2dc0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:23.853914 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f820b92-bdc1-4d4d-aa61-d5e381ab2dc0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:23.858861 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:23.866113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:23.866113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:23.866113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:23.866113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 11:46:23.866113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:23.866113 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:23.874531 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1446/2894] 10.222.0.86 () {58 vars in 1153 bytes} [Thu Aug 18 11:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 11:46:23.878996 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b18e40-470e-45c0-92cf-b5110fcfb55f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:23.888517 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b18e40-470e-45c0-92cf-b5110fcfb55f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:23.893360 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:23.893959 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:23.894243 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:23.894518 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:23.895190 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:23.897126 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:23.979661 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1449/2895] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:46:23 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:46:23.983435 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:23.993749 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb9322-e6d4-49ef-9633-7c21b47a0b8e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:24.050615 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:24.051275 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:24.051557 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:24.051832 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:24.052498 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:24.054405 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:24.187904 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1447/2896] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:46:23 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:46:24.192193 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:24.202663 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67bdb2-a80d-46b6-b8ba-180bf7c96fe0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:24.207508 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:24.208097 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:24.208407 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:24.208680 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:24.209325 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:24.210906 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:24.221860 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1450/2897] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:46:24.230686 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:24.240711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35265459-a2ef-4a89-b6d3-180514414aa6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:24.245328 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a43fb-4a19-4fb1-9a52-e139ceb7a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:24.245923 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a43fb-4a19-4fb1-9a52-e139ceb7a7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:24.246207 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a43fb-4a19-4fb1-9a52-e139ceb7a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:24.246485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a43fb-4a19-4fb1-9a52-e139ceb7a7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:24.247125 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a43fb-4a19-4fb1-9a52-e139ceb7a7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:24.248830 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a43fb-4a19-4fb1-9a52-e139ceb7a7e8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:24.259220 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1448/2898] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:46:24.263772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:24.274000 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d2834-963e-4f38-ad51-f8716cd2f40d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:24.279222 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:24.279864 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:24.280141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:24.280514 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] PATH_INFO: `/v3/projects/2cdd37459fbd4d8db4a591c2ebae8e4b/users/37119fa4b3394e1aa9771efe2ae0c8b8/roles/7e46fd9311c848bb8730f41e91ba92ea` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:24.295632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdd37459fbd4d8db4a591c2ebae8e4b, user_id=37119fa4b3394e1aa9771efe2ae0c8b8, role_id=7e46fd9311c848bb8730f41e91ba92ea)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:24.298401 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:24.376030 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1451/2899] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:46:24 2022] PUT /identity/v3/projects/2cdd37459fbd4d8db4a591c2ebae8e4b/users/37119fa4b3394e1aa9771efe2ae0c8b8/roles/7e46fd9311c848bb8730f41e91ba92ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:46:24.381411 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c117f6-40a8-4c2a-8e8c-b2f65932a7cf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:24.381705 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c117f6-40a8-4c2a-8e8c-b2f65932a7cf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:24.381986 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c117f6-40a8-4c2a-8e8c-b2f65932a7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:24.401966 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b4c117f6-40a8-4c2a-8e8c-b2f65932a7cf None None] MFA Rules not processed for user `235b477955ee423a9e9419b7e417b291`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:24.403171 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b4c117f6-40a8-4c2a-8e8c-b2f65932a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:24.463438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1449/2900] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:24.473150 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:24.474911 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:24.498139 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:24.534467 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21401cc1-c777-4edb-9d6e-e597dffc9d9d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:24.538219 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:24.538853 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:24.539134 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:24.539408 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:24.548605 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:24.550082 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:24.559973 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1452/2901] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:46:29.968994 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0972b-1380-444d-9f56-4ab7f608f790 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:29.969552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0972b-1380-444d-9f56-4ab7f608f790 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:29.969552 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0972b-1380-444d-9f56-4ab7f608f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:30.000438 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5dc0972b-1380-444d-9f56-4ab7f608f790 None None] MFA Rules not processed for user `37119fa4b3394e1aa9771efe2ae0c8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:30.001587 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5dc0972b-1380-444d-9f56-4ab7f608f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:30.019589 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:30.066559 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1450/2902] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:30.071045 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:30.081840 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2ab0-18dc-4e87-b094-6dcdd983bf62 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:30.086533 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:30.087127 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:30.087653 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:30.087944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:30.088619 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:30.090504 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:30.191343 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1453/2903] 10.222.0.86 () {60 vars in 1153 bytes} [Thu Aug 18 11:46:30 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:46:30.192491 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0972b-1380-444d-9f56-4ab7f608f790 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:30.204140 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0972b-1380-444d-9f56-4ab7f608f790 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:30.263178 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:30.263703 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:30.263989 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:30.264309 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:30.264946 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:30.266907 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:30.360102 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1451/2904] 10.222.0.86 () {60 vars in 1144 bytes} [Thu Aug 18 11:46:30 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 11:46:30.364151 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:30.375457 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c7d2-58c6-454e-a2da-e6d3dbbfbf9a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:30.380180 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:30.380808 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:30.381099 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:30.381379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:30.382063 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:30.383665 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:30.395076 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1454/2905] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:46:30.399514 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:30.410174 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed8039-a60c-4537-9092-6873ecd82653 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:30.415130 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:30.416371 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:30.416647 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:30.416975 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] PATH_INFO: `/v3/projects/0219f78b2bd44c0da9d9046724166b70/users/c5f0111d73a146459d168387b3bbed70/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:30.435549 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0219f78b2bd44c0da9d9046724166b70, user_id=c5f0111d73a146459d168387b3bbed70, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:30.438539 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:30.508445 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1452/2906] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:46:30 2022] PUT /identity/v3/projects/0219f78b2bd44c0da9d9046724166b70/users/c5f0111d73a146459d168387b3bbed70/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:46:30.512674 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:30.523477 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba7378-55d5-41ca-99eb-f324bd3a5fd5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:30.582109 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac7901-ded4-44fa-96c0-95c4f6be3cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:30.583259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7901-ded4-44fa-96c0-95c4f6be3cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:30.583259 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7901-ded4-44fa-96c0-95c4f6be3cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:30.583493 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7901-ded4-44fa-96c0-95c4f6be3cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:30.583928 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac7901-ded4-44fa-96c0-95c4f6be3cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:30.585654 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac7901-ded4-44fa-96c0-95c4f6be3cc1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:30.595945 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1455/2907] 10.222.0.86 () {58 vars in 1122 bytes} [Thu Aug 18 11:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 11:46:30.600231 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:30.612480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148fe3e-d856-4da9-be06-c1ca70d4af17 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:30.617322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:30.617992 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:30.618276 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:30.618603 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] PATH_INFO: `/v3/projects/0219f78b2bd44c0da9d9046724166b70/users/c5f0111d73a146459d168387b3bbed70/roles/e15e6a68b97848f894a24857503ceab4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:30.621322 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0219f78b2bd44c0da9d9046724166b70, user_id=c5f0111d73a146459d168387b3bbed70, role_id=e15e6a68b97848f894a24857503ceab4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:30.623982 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:30.634578 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1453/2908] 10.222.0.86 () {60 vars in 1483 bytes} [Thu Aug 18 11:46:30 2022] PUT /identity/v3/projects/0219f78b2bd44c0da9d9046724166b70/users/c5f0111d73a146459d168387b3bbed70/roles/e15e6a68b97848f894a24857503ceab4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 11:46:36.303402 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c582-9f8b-43b2-9d53-906220b21de7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:36.303966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c582-9f8b-43b2-9d53-906220b21de7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:36.304070 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c582-9f8b-43b2-9d53-906220b21de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:36.346273 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ea64c582-9f8b-43b2-9d53-906220b21de7 None None] MFA Rules not processed for user `c5f0111d73a146459d168387b3bbed70`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:36.347410 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ea64c582-9f8b-43b2-9d53-906220b21de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:36.419556 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:36.452502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1456/2909] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:36.466271 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:36.467919 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:36.548586 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:36.574323 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf25d9-80b0-4388-8147-061a315f36a3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:36.578546 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '514818f5b23c4234b259e5b47e698a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:36.580722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:36.580722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:36.580722 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:36.636663 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:36.638085 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:36.646869 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1454/2910] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:46:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:46:36.924602 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768b47c-0724-4d09-bd8c-2e4c15e5a0a0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:36.924898 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768b47c-0724-4d09-bd8c-2e4c15e5a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:36.925166 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768b47c-0724-4d09-bd8c-2e4c15e5a0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:36.945876 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3768b47c-0724-4d09-bd8c-2e4c15e5a0a0 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:36.947281 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3768b47c-0724-4d09-bd8c-2e4c15e5a0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:37.011495 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1457/2911] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:46:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:37.158372 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:37.159792 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:37.248123 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077adcb-a878-4389-a0d2-0941b7541bd2 service glance] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:37.253413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:37.254034 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:37.254317 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:37.254590 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:37.265293 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:37.266901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:37.278848 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1455/2912] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:46:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:47.004587 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=35 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:47.273066 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=66 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:47.465632 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfedc3-3b78-40df-9e87-a87c8ddd7756 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:47.465966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfedc3-3b78-40df-9e87-a87c8ddd7756 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:47.466241 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfedc3-3b78-40df-9e87-a87c8ddd7756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:47.485453 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-21cfedc3-3b78-40df-9e87-a87c8ddd7756 None None] MFA Rules not processed for user `37119fa4b3394e1aa9771efe2ae0c8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:47.491684 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-21cfedc3-3b78-40df-9e87-a87c8ddd7756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:47.494484 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1458/2913] 10.222.0.86 () {58 vars in 958 bytes} [Thu Aug 18 11:46:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:49.163413 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:49.164872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:49.235998 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac09cf5-e0ca-4050-84de-ba5133943891 service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:49.241158 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:49.241820 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:49.242105 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:49.242379 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:49.244634 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:49.256706 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:49.258466 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:49.270147 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1456/2914] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:46:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:46:55.237919 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:55.238386 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:55.238502 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:55.257759 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:46:55.258966 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:55.266182 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1459/2915] 10.222.0.86 () {58 vars in 1009 bytes} [Thu Aug 18 11:46:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:46:55.280050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:55.292106 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49d0a-ee18-4055-b60f-f32d6e7b7f09 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:55.298228 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:55.298835 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:55.299131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:55.299385 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:55.307901 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:55.309984 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:55.318442 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1457/2916] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:56.414617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:46:56.416432 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:56.527956 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03dd6-1963-4723-8329-9f3aad08fd0c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:46:56.534117 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:46:56.534736 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:46:56.535022 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:46:56.535308 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:46:56.537100 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:46:56.550875 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:46:56.552535 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:46:56.564142 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1460/2917] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:46:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:47:05.314855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=38 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:06.559123 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=40 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:12.969716 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:47:12.973377 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:47:12.987934 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3716031-b374-42f6-92a8-8d01eff0b6aa service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:47:12.993773 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:47:12.994368 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:47:12.994650 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:47:12.994925 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:47:12.997131 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:47:13.009370 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:47:13.010955 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:47:13.021737 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1458/2918] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:47:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:47:22.237313 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:47:22.238727 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:47:22.317529 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da17b2-6a0f-4520-9aad-f7a2420e5c00 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:47:22.321223 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:47:22.321826 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:47:22.322106 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:47:22.322379 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:47:22.331583 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:47:22.333036 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:47:22.342322 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1461/2919] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:47:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:47:23.017128 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:24.644485 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:47:24.659398 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fd48-29d9-48b6-9303-708dac262ad2 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:47:24.665305 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '748eb93057e245c1b8183dbe0340fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:47:24.665888 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:47:24.666167 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:47:24.666439 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:47:24.668187 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:47:24.681768 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:47:24.683278 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:47:24.694948 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1459/2920] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:47:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:47:32.338136 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=35 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:34.690967 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:56.446305 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:47:56.447685 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:47:56.485412 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffbc1f-a471-4204-8245-fca456957d4f service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:47:56.490486 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21828235-0e69-4013-b1a8-ef77af404698 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:47:56.491083 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21828235-0e69-4013-b1a8-ef77af404698 service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:47:56.491405 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21828235-0e69-4013-b1a8-ef77af404698 service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:47:56.491675 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21828235-0e69-4013-b1a8-ef77af404698 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:47:56.493397 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-21828235-0e69-4013-b1a8-ef77af404698 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:47:56.504804 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21828235-0e69-4013-b1a8-ef77af404698 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:47:56.506363 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21828235-0e69-4013-b1a8-ef77af404698 service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:47:56.517278 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1462/2921] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:47:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:48:06.512088 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=15 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:50.825872 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:49:50.835681 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c6a0-98c6-478c-8dc4-710108c96f5a service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:49:50.839480 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd4d0f2f95b4861888c33b0c66c602b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:49:50.840079 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:49:50.840406 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:49:50.840709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:49:50.842565 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:49:50.876423 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:49:50.877855 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:49:50.898709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1460/2922] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:49:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:49:55.626440 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5932cd-d586-4d58-826a-202470837a74 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:49:55.627023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5932cd-d586-4d58-826a-202470837a74 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:49:55.627023 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5932cd-d586-4d58-826a-202470837a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:49:55.658978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bd5932cd-d586-4d58-826a-202470837a74 None None] MFA Rules not processed for user `5409b17aa2224f0fa60de95d5fc2e892`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 11:49:55.658978 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bd5932cd-d586-4d58-826a-202470837a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:49:55.665813 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1463/2923] 10.222.0.86 () {58 vars in 967 bytes} [Thu Aug 18 11:49:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 11:49:55.707464 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:49:55.719410 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705eee54-9720-4f11-a97c-8cfe42a53769 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:49:55.724469 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecc15bbe7f4a71ac8821ea057153b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:49:55.725069 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:49:55.725348 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:49:55.725620 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:49:55.734711 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:49:55.736525 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:49:55.745454 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1461/2924] 10.222.0.86 () {60 vars in 1384 bytes} [Thu Aug 18 11:49:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 11:50:03.908487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5932cd-d586-4d58-826a-202470837a74 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:50:03.991703 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5932cd-d586-4d58-826a-202470837a74 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:50:03.996526 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:50:03.996863 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:50:03.997129 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:50:03.997403 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] PATH_INFO: `/v3/users/37119fa4b3394e1aa9771efe2ae0c8b8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:50:03.999292 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37119fa4b3394e1aa9771efe2ae0c8b8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:50:04.001287 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:50:04.206141 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37119fa4b3394e1aa9771efe2ae0c8b8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.206900 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37119fa4b3394e1aa9771efe2ae0c8b8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.219057 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37119fa4b3394e1aa9771efe2ae0c8b8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.219700 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37119fa4b3394e1aa9771efe2ae0c8b8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.289359 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37119fa4b3394e1aa9771efe2ae0c8b8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.302060 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1464/2925] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:50:03 2022] DELETE /identity/v3/users/37119fa4b3394e1aa9771efe2ae0c8b8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:50:04.549282 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:50:04.560709 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5dd34-a2ba-4745-a663-7b207efba152 service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:50:04.619898 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:50:04.620562 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:50:04.620843 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:50:04.621117 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] PATH_INFO: `/v3/projects/2cdd37459fbd4d8db4a591c2ebae8e4b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:50:04.622223 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdd37459fbd4d8db4a591c2ebae8e4b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:50:04.625162 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:50:04.712048 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdd37459fbd4d8db4a591c2ebae8e4b', 'request_id': 'req-1086a752-f559-460c-8150-43f1b8a4786c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.717933 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdd37459fbd4d8db4a591c2ebae8e4b', 'request_id': 'req-1086a752-f559-460c-8150-43f1b8a4786c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.724177 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdd37459fbd4d8db4a591c2ebae8e4b', 'request_id': 'req-1086a752-f559-460c-8150-43f1b8a4786c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.800191 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] The token cache is being invalidate because project 2cdd37459fbd4d8db4a591c2ebae8e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:50:04.800449 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.801055 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:04.802575 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1462/2926] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:50:04 2022] DELETE /identity/v3/projects/2cdd37459fbd4d8db4a591c2ebae8e4b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:50:04.806886 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:50:04.808315 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:50:04.822144 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360ede8-90b4-4131-a9e8-2a4debd0c8e1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:50:04.872770 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:04.885570 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:50:04.886211 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:50:04.886494 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:50:04.886772 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] PATH_INFO: `/v3/users/c5f0111d73a146459d168387b3bbed70` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:50:04.887907 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f0111d73a146459d168387b3bbed70)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:50:04.889944 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:50:05.086617 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f0111d73a146459d168387b3bbed70'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.087289 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f0111d73a146459d168387b3bbed70'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.099948 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f0111d73a146459d168387b3bbed70'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.100618 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f0111d73a146459d168387b3bbed70'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.180833 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f0111d73a146459d168387b3bbed70'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.194191 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1465/2927] 10.222.0.86 () {58 vars in 1224 bytes} [Thu Aug 18 11:50:04 2022] DELETE /identity/v3/users/c5f0111d73a146459d168387b3bbed70 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:50:05.457560 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:50:05.462752 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:50:05.474163 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a752-f559-460c-8150-43f1b8a4786c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:50:05.499953 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:05.532658 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235b477955ee423a9e9419b7e417b291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83901483583f4a448b5d5f90ea5d58ed', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:50:05.533408 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:50:05.533699 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:50:05.533974 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] PATH_INFO: `/v3/projects/0219f78b2bd44c0da9d9046724166b70` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:50:05.535099 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0219f78b2bd44c0da9d9046724166b70)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:50:05.537050 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:50:05.639331 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0219f78b2bd44c0da9d9046724166b70', 'request_id': 'req-322238dc-896a-45b5-a2ea-0c90096c6db4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.645602 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0219f78b2bd44c0da9d9046724166b70', 'request_id': 'req-322238dc-896a-45b5-a2ea-0c90096c6db4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.652774 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0219f78b2bd44c0da9d9046724166b70', 'request_id': 'req-322238dc-896a-45b5-a2ea-0c90096c6db4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.735930 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] The token cache is being invalidate because project 0219f78b2bd44c0da9d9046724166b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 11:50:05.736234 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.736883 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-322238dc-896a-45b5-a2ea-0c90096c6db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 11:50:05.738363 dv-cinder-853450-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1463/2928] 10.222.0.86 () {58 vars in 1233 bytes} [Thu Aug 18 11:50:05 2022] DELETE /identity/v3/projects/0219f78b2bd44c0da9d9046724166b70 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 11:50:15.190726 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:15.732070 dv-cinder-853450-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:01.480986 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 11:53:01.482406 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:53:01.555616 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbfdcc-73ff-4299-9709-49450770c442 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 11:53:01.616487 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b4c76-8690-4fd8-9401-84748224373e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69dfae99c30d4a2a89199a3da610b8bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b002c61ded604953bd192ac248b1ae18', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 11:53:01.617135 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4c76-8690-4fd8-9401-84748224373e service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 11:53:01.617418 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4c76-8690-4fd8-9401-84748224373e service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 11:53:01.617692 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b4c76-8690-4fd8-9401-84748224373e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 11:53:01.619466 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-384b4c76-8690-4fd8-9401-84748224373e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 11:53:01.631905 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b4c76-8690-4fd8-9401-84748224373e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 11:53:01.633537 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b4c76-8690-4fd8-9401-84748224373e service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 11:53:01.643344 dv-cinder-853450-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1466/2929] 10.222.0.86 () {60 vars in 1365 bytes} [Thu Aug 18 11:53:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 11:53:11.639119 dv-cinder-853450-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=58 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}